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(54) Service relay apparatus for providing multimedia content information to a user terminal 



(57) A system is arranged by a service providing 
apparatus (109) for storing a plurality of contents data 
(110) and capable of transmitting the contents data via 
network interfaces (116a/116b) and a communication 
path (112); and also a service relaying apparatus (101) 
for producing compressed moving picture data having a 
high image quality from still picture data, and capable of 
transmitting the compressed moving picture data via 



network interfaces (115a/115b) and another communi- 
cation path (1 1 1 ) to a reproducing terminal (106). As a 
result, desirable contents data can be displayed by the 
reproducing terminal which owns a capability of display- 
ing the compressed moving picture data, but does not 
own such a capability of displaying the desirable con- 
tents data. 
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Description 

BACKGROUND OF THE INVENTION 

{0001] The present invention is related to an infor- 
mation providing apparatus constituted by a computer, 
and a digital network such as a LAN (Local-Area Net- 
work) and a public telephone network. 
[0002] Now, such an information providing appara- 
tus will be considered. This information providing appa- 
ratus owns a client-server type structure. The client- 
server type structure is arranged by a personal compu- 
ter, a digital network, and the like. The digital network 
corresponds to a LAN (Local-Area Network), a public 
telephone network, and the like. Fig. 28 shows a struc- 
tural diagram of a general-purpose information provid- 
ing apparatus. 

[0003] In Fig. 28, reference numeral 2801 indicates 
a service providing apparatus, reference numeral 2802 
represents a reproducing terminal, and reference 
numeral 2803 denotes a communication path. 
[0004] The service providing apparatus 2801 is pro- 
vided with a storage device having a large storage 
capacity and constructed of a hard disk unit and the like. 
The service providing apparatus 2801 stores contents 
data into this storage device, and transmits the contents 
data to the reproducing terminal 2802 in response to a 
request issued from the reproducing terminal 2802. 
[0005] The reproducing terminal 2802 acquires 
desirable contents data from the service providing 
apparatus 2801 via the communication path 2803, 
reproduces the acquired desirable contents data, and 
then displays the reproduced desirable contents data. 
Apparently, the reproducing terminal 2802 is required to 
own a capability of decoding various data which consti- 
tute the contents data. As an example of the above- 
explained information providing manner, such contents 
data which is described by using the HTML (Hyper Text 
Markup Language) in the WWW (World Wide Web) is 
reproduced/displayed by way of "Internet Explorer" by 
Microsoft, which is widely utilized so as to view home 
pages on personal computers. In this case, generally 
speaking, a personal computer is used as this reproduc- 
ing terminal 2802. 

[0006] Since mobile appliances are nowadays pop- 
ularized, the following information providing systems as 
the reproducing terminal 2802 may be expected in 
future. That is, this forthcoming information providing 
system employs a portable information terminal (PDA: 
Personal Digital Assistants), and a portable telephone. 
In general, performance capabilities of a CPU (central 
processing unit) and a storage device employed in this 
reproducing terminal 2802 are low, as compared with 
performance capabilities of personal computers. 
Although this reproducing terminal 2802 cannot hardly 
reproduce/display contents data described by using the 
HTML, various performance limitations should be given, 
for example, only character data may be displayed, and 
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also black/white still picture image data may be dis- 
played. 

[0007] When newly developed mobile communica- 
tion networks (IMT-2000: International Mobile Telecom- 

5 munications-2000) using the W-CDMA (Wideband 
Code Division Multiple Access) system are popularized, 
the data transfer capability per unit time of the commu- 
nication path 2803 may be improved, and contents data 
used to provide information may be widely changed 

io such as still picture data made in a full color, and moving 
picture data combined with audio data. 
[0008] For instance, the following idea is now con- 
sidered. That is, a full-colored still picture compressed 
by the JPEG (Joint-photographic Experts Group) format 

15 (will be referred to as a "JPEG still picture" hereinafter) 
is displayed on a portable information terminal and a 
portable telephone. One realistic means may be con- 
ceived. That is, such a portable information terminal 
and/or a portable telephone is equipped with a function 

20 capable of decoding a JPEG still picture. However, this 
realistic means owns the bellow-mentioned several 
problems. 

[0009] A first problem is given as follows: 

[001 0] A time period defined after a display request 

25 is issued and up to the display is accomplished is pro- 
long. For example, a data amount of such a JPEG still 
picture which is made of 768 pixels (longitudinal direc- 
tion) x 1 ,024 pixels (lateral direction) and is taken by an 
electronic still camera is substantially equal to 100 K 

30 bytes. In this case, symbol "K" implies 1 ,024. In such a 
case that this JPEG still image is acquired via a mobile 
communication network having a data transfer capabil- 
ity of 64 Kbps (namely, 64,000 bits/second) and then is 
displayed on a portable telephone, an operator of this 

35 portable te lep hone mu st wait approximately 1 3 seco nds 
until the picture data transfer operation is accomplished. 
[001 1] A second problem is given as follows: 
[0012] That is, a total number of components of a 
portable information terminal and/or a portable tele- 

40 phone is increased. This is because that a decoder for a 
JPEG still picture and a storage device for temporarily 
storing a JPEG still picture must be provided in such a 
portable information terminal and/or a portable tele- 
phone. Also, since such a function is newly employed, 

45 power consumption is necessarily increased. To accept 
increased power consumption, a capacity of a battery 
must be increased. These restrictions can be hardly 
accepted by these terminals whose features are a com- 
pactness and light weight. 

so [0013] A third problem is given as follows: 

[0014] That is, a portable information terminal 
and/or a portable telephone can be hardly operated by 
processing various sorts of contents data. Every time 
contents data having a new data format appears in the 

55 field, such a display function capable of displaying this 
newly formatted contents data must be provided in the 
portable information terminal and the portable tele- 
phone, resulting in a very difficult solution. In other 
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words, it is practically very difficult to install such a nec- 
essary contents data reproducing software program in 
these portable information terminal and portable tele- 
phone every time newly formatted contents data is 
present. Such a program install work is generally car- s 
ried out in personal computers. 

SUMMARY OF THE INVENTION 

[0015] An object of the present invention is to pro- 
vide such a means capable of reproducing/displaying 
various sorts of contents data such as full-colored still 
picture data having a high image quality and three- 
dimensional (3D) computer graphics, while using a 
reproducing terminal such as a portable information ter- 
minal and a portable telephone. A data processing 
capability of this reproducing terminal is made lower 
than that of a personal computer, while this reproducing 
terminal does not own a capability of displaying image 
data such as a JPEG still picture. 
[0016] To solve this problem, firstly, the present 
invention is directed to a service relaying apparatus. 
That is, the service relaying apparatus according to first 
invention acquires data from a service providing appa- 
ratus capable of storing a plurality of contents data and 
also capable of sending out contents data via a network 
interface in response to a request; and converts the for- 
mat of the acquired data into such a format thereof that 
this acquired data can be reproduced without any prob- 
lem even in a user environment (performance of repro- 
ducing terminal). Then, the information providing 
apparatus transmits the data with the converted format. 
[0017] This service relaying apparatus, according 
to the first invention, comprises: picture data relaying 
means capable of utilizing contents data reproducing 
software operated on a general-purpose personal com- 
puter as reproducing means, and for relaying to moving 
picture coding means, still picture data originated from 
contents data which is obtained by reproducing the con- 
tents data acquired from the service providing appara- 
tus via the network interface by this reproducing means; 
moving picture coding means for producing com- 
pressed moving picture data having a high image qual- 
ity from the still picture image data by way of a stepwise 
image quality complementary type coding system, and 
for transmitting the compressed moving picture data via 
a second network interface to the reproducing terminal; 
and control means for determining an area of still pic- 
ture data coded into the compressed moving picture 
data in response to a manipulation made from the 
reproducing terminal, and capable of notifying the deter- 
mined area to the moving picture coding means. 
[0018] As a result, the desirable contents data can 
be reproduced by such a reproducing terminal which 
owns the display capability of the compressed moving 
picture data, but does not have the capability of display- 
ing the desirable contents data. In addition, the repro- 
ducing terminal can display an arbitrarily selected 



portion of contents data displayed on this reproducing 
terminal in an enlarging manner. 
[0019] Also, secondly, in the service relaying appa- 
ratus according to the first invention, the control means 
may produce a control signal for changing a display 
state of the reproducing means by receiving a button 
manipulation made in the reproducing terminal, and 
then may transmit the produced control signal. Also, the 
control means may determine the area of the still picture 
data coded in the compressed moving picture data, and 
then may transmit the determined area to the moving 
picture coding means. The moving picture coding 
means produces compressed moving picture data from 
such still picture data, the content of which is sequen- 
tially changed by changing a setting condition of coding 
process operation, if necessary. 

[0020] As a result, the desirable contents data can 
be reproduced by such a reproducing terminal which 
owns the display capability of the compressed moving 
picture data, but does not have the capability of display- 
ing the desirable contents data. In addition, the repro- 
ducing terminal can display an arbitrarily selected 
portion of contents data displayed on this reproducing 
terminal in an enlarging manner. Also, the reproducing 
terminal can display the relevant contents data by mov- 
ing the displayed content along upper/lower directions 
and right/left directions, and by arbitrarily selecting the 
displayed link information. 

[0021] Also, thirdly, in the service relaying appara- 
tus according to the first invention, the moving picture 
coding means may also produce audio data having a 
designated data format from audio data contained in the 
contents data, may produce multiplexed AV data by 
multiplexing the compressed moving data with the audio 
data, and may transmit the multiplexed AV data via the 
second network interface to the reproducing terminal. 
[0022] As a result, the desirable contents data can 
be reproduced by such a reproducing terminal which 
owns the display capability of the multiplexed AV data, 
but does not have the capability of displaying the desir- 
able contents data, while reproducing the audio. In addi- 
tion, the reproducing terminal can display an arbitrarily 
selected portion of contents data displayed on this 
reproducing terminal in an enlarging manner. 
[0023] Also, fourthly, the present invention is 
directed to such an apparatus arranged by combining 
the service providing apparatus with the service relay- 
ing apparatus in an integral form, according to the first 
present invention. 

[0024] As a result, the desirable contents data can 
be reproduced by such a reproducing terminal which 
owns the display capability of the compressed moving 
picture data, but does not have the capability of display- 
ing the desirable contents data. In addition, the repro- 
ducing terminal can display an arbitrarily selected 
portion of contents data displayed on this reproducing 
terminal in an enlarging manner. 
[0025] Also, fifthly, the present invention is directed 
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to such an apparatus arranged by combining the serv- 
ice providing apparatus with the service relaying appa- 
ratus in an integral form, according to the second 
present invention. 

[0026] As a result, the desirable contents data can 
be reproduced by such a reproducing terminal which 
owns the display capability of the compressed moving 
picture data, but does not have the capability of display- 
ing the desirable contents data. In addition, the repro- 
ducing terminal can display an arbitrarily selected 
portion of contents data displayed on this reproducing 
terminal in an enlarging manner. Also, the reproducing 
terminal can display the relevant contents data by mov- 
ing the displayed content along upper/lower directions 
and right/left directions, and by arbitrarily selecting the 
displayed link information. 

[0027] Also, sixthly, the present invention is directed 
to such an apparatus arranged by combining the serv- 
ice providing apparatus with the service relaying appa- 
ratus in an integral form, according to the third present 
invention. 

[0028] As a result, the desirable contents data can 
be reproduced by such a reproducing terminal which 
owns the display capability of the multiplexed AV data, 
but does not have the capability of displaying the desir- 
able contents data, while reproducing the audio. In addi- 
tion, the reproducing terminal can display an arbitrarily 
selected portion of contents data displayed on this 
reproducing terminal in an enlarging manner. 

BRIEF DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

[0029] 

Fig. 1 is a structural diagram for showing a first 
embodiment mode of the present invention; 
Fig. 2 is a structural diagram for indicating a control 
apparatus in the first embodiment mode of the 
present invention; 

Fig. 3 is a structural diagram for representing a 
moving picture coding apparatus in the first embod- 
iment mode of the present invention; 
Fig. 4 is a schematic diagram for representing a 
relationship between display areas of contents in 
the first embodiment mode of the present invention; 
Fig. 5 is a flow chart for describing operations of a 
data acquiring unit in the first embodiment mode of 
the present invention; 

Fig. 6 is a conceptional diagram for representing an 
MPEG type video coding process operation in the 
first embodiment mode of the present invention; 
Fig. 7 is a diagram for explaining an example of for- 
mulae indicative of a change in reproduced image 
qualities caused by a stepwise image quality com- 
plementary type coding process operation in the 
first embodiment mode of the present invention; 
Fig. 8 is a structural diagram for showing an opera- 
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tion button 1 17 in the first embodiment mode of the 
present invention; 

Fig. 9 is a diagram for representing an example of 
still pictures to a terminal in the first embodiment 

5 mode of the present invention; 

Fig. 1 0 is a structural diagram for showing a picture 
data relaying apparatus by using a semiconductor 
memory such as a DRAM in the first embodiment 
mode of the present invention; 

to Fig. 1 1 is a structural diagram for showing a second 
embodiment mode of the present invention; 
Fig. 12 is a structural diagram for indicating a con- 
trol apparatus in the second embodiment mode of 
the present invention; 

15 Fig. 13 is a flow chart for describing operation of a 
relay control unit when a direction signal is received 
in the second embodiment mode of the present 
invention; 

Fig. 1 4 is a flow chart for describing operation of the 

20 relay control unit when a pointing cursor is moved in 
the second embodiment mode of the present inven- 
tion; 

Fig. 1 5 is a flow chart for describing operation of the 
relay control unit when link information is selected 
25 and defined in the second embodiment mode of the 
present invention; 

Fig. 16 is a structural diagram for showing a third 
embodiment mode of the present invention; 
Fig. 17 is a structural diagram for indicating a con- 
30 trol apparatus in the third embodiment mode of the 
present invention; 

Fig. 18 is a flowchart for describing operation of a 
relay control unit when contents data is moved 
along upper-lower-right-left directions in the third 
35 embodiment mode of the present invention; 

Fig. 1 9 is a flow chart for describing operation of the 
relay control unit when a pointing cursor is moved in 
the third embodiment mode of the present inven- 
tion; 

40 Fig. 20 is a flow chart for describing operation of the 
relay control unit when link information is selected 
and defined in the third embodiment mode of the 
present invention; 

Fig. 21 is a structural diagram for showing a fourth 
45 embodiment mode of the present invention; 

Fig. 22 is a structural diagram for indicating a mov- 
ing picture coding apparatus in the fourth embodi- 
ment mode of the present invention; 
Fig. 23 is a structural diagram for indicating a fifth 
so embodiment mode of the present invention; 

Fig. 24 is a structural diagram for indicating a sixth 
embodiment mode of the present invention; 
Fig. 25 is a structural diagram for indicating a sev- 
enth embodiment mode of the present invention; 
55 Fig. 26 is an illustrative diagram of a network infra- 
structure in the first to fourth embodiment modes of 
the present invention; 

Fig. 27 is an illustrative diagram of a network infra- 
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structure in the fifth to seventh embodiment modes 
of the present invention; and 
Fig. 28 is a structural diagram for showing a gen- 
eral-purpose information providing apparatus. 

5 

DETAILED DESCRIPTION OF THE PR EFERRED 
EMBODIMENTS 

[0030] Referring now to Fig. 1 to Fig. 27, various 
embodiment modes of the present invention will be io 
described. It should be noted that the present invention 
is not limited only to these embodiment modes, but may 
be embodied in various modes without departing from 
the technical scope and spirit of the present invention. 

15 

EMBODIMENT 1 

[0031] A first embodiment mode of the present 
invention will now be described with reference to Fig. 1 
to Fig. 11. 20 
[0032] Fig. 1 represents a structural diagram of the 
first embodiment mode. In Fig. 1, reference numeral 
101 shows a service relaying apparatus; reference 
numeral 102 indicates a reproducing apparatus; refer- 
ence numeral 103 represents an image data relaying 25 
apparatus; reference numeral 104 shows a moving pic- 
ture coding apparatus; and reference numeral 105 is a 
control apparatus. Also, reference numeral 106 shows a 
multimedia communication terminal functioning as a 
reproducing terminal; reference numeral 107 repre- 30 
sents a moving picture reproducing apparatus; refer- 
ence numeral 108 indicates a contents viewing 
apparatus; reference numeral 109 denotes a service 
providing apparatus; and reference numeral 1 1 0 is con- 
tents data. Also, reference numeral 1 1 1 shows a com- 35 
munication path between the terminal 106 and the 
service relaying apparatus 101 ; reference numeral 112 
shows a communication path between the service pro- 
viding apparatus 109 and the service relaying appara- 
tus 101; reference numeral 113 represents a control 40 
signal of the reproducing apparatus 102; reference 
numeral 114 indicates a control signal of the moving 
picture coding apparatus 1 04; reference numerals 1 15a 
and 115b represent network interfaces provided in the 
service relaying apparatus 101 and the multimedia 45 
communication terminal 106, respectively; reference 
numerals 116a and 116b show network interfaces pro- 
vided in the service relaying apparatus 101 and the 
service providing apparatus 109, respectively; and also 
reference numeral 117 denotes an operation button. so 
[0033] First, a description will now be made of usa- 
ble modes directed to this embodiment mode. 
[0034] The service providing apparatus 109 stores 
digital still pictures (will be referred to as "still pictures" 
hereinafter) as the contents data 110. The multimedia 55 
communication terminal (will be referred to as a "termi- 
nal "hereinafter) 106 acquires arbitrary contents data 
(namely, still picture in this case) with a format displaya- 



ble on the own display means, and then displays this 
acquired arbitrary contents data thereon. A size of the 
terminal 106 is selected to be substantially equal to a 
typical size of a portable telephone. As a result, a dis- 
play apparatus of this terminal 106 is a liquid crystal dis- 
play (LCD), the screen size of which is small, for 
instance, on the order of 2 inches measured along a 
diagonal length. 

[0035] On the other hand, as a still picture, image 
data photographed by a digital still camera and the like 
may be employed. A size of such a still picture would 
become very large, for example, 1 ,024 pixels x 768 pix- 
els, as compared with the dimension of the display 
apparatus employed in the terminal 106. When such a 
contents data 1 10 is displayed on the terminal 106, the 
entire area of the contents data 1 10 is first compressed 
and then, the compressed contents data is displayed. 
As apparent from the foregoing description, the entire 
image of the contents data displayed on the terminal 

1 06 owns low visibility as to very small areas thereof. As 
a result, an arbitrary partial portion of the contents data 
110 is enlarged by arbitrarily setting magnification by 
manipulating the operation button 117 equipped on the 
terminal 106 so as to display a detailed portion of this 
contents data 1 10. 

[0036] Next, a description will be made of both 
operations of this embodiment mode and realizing 
means thereof. 

[0037] The terminal 1 06 is provided with the moving 
picture reproducing apparatus 107, the contents data 
viewing apparatus 108, and the operation button 117. 
This terminal 106 performs such a communication 
standardized by a protocol designed to establish a com- 
munication path, for instance, recommendations H. 320, 
H. 323, H. 324 and the like of International Telecommu- 
nication Union-Telecommunication Sector (will be 
referred to "ITU-T" hereinafter). 

[0038] The contents viewing apparatus 108 corre- 
sponds to such an apparatus for displaying the contents 
data 110 which is acquired from the service providing 
apparatus 109 via the service relaying apparatus 101, 
the communication path 111, and the communication 
path 112. Also, this contents viewing apparatus 108 
decodes compressed moving picture data by using the 
moving picture reproducing apparatus 107 to display 
thereon the decoded moving picture data, if required. In 
addition, the contents viewing apparatus 108 provides a 
function for selecting the contents data 1 10 by using the 
operation button 117. 

[0039] In this embodiment mode, the terminal 106 
displays character data indicative of menu and the like, 
which is contained in the contents data 110, by using 
the own function of this contents viewing apparatus 1 08, 
and also displays the compressed moving picture data 
by using the moving picture reproducing apparatus 1 07. 
[0040] The moving picture reproducing apparatus 

107 decodes the compressed moving picture data and 
displays the decoded moving picture data under control 
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of the contents viewing apparatus 108. In such a case 
that the compressed moving picture data under recep- 
tion is stopped, the moving picture reproducing appara- 
tus 107 stops the image display at this time, and 
maintains the display state during a time period until the 
compressed moving picture data is newly received. 
[0041] The service relaying apparatus 101 corre- 
sponds to such an apparatus located at an intermediate 
position between the terminal 1 06 and the service pro- 
viding apparatus 109. This service relaying apparatus 
101 supplies the contents data 110 constituted by the 
character to the contents viewing apparatus 108. Also, 
the service relaying apparatus 101 converts such a con- 
tents data 110 which cannot be displayed on the con- 
tents viewing apparatus 108, into compressed moving 
picture data, and then transmits this converted com- 
pressed moving picture data to the moving picture 
reproducing apparatus 107. 

[0042] Operations of the service relaying apparatus 
101 will now be explained. 

[0043] Fig. 2 shows an arrangement of the control 
apparatus 105 for controlling the service relaying appa- 
ratus 101. In Fig. 2, reference numeral 201 indicates a 
relay control unit, reference numeral 202 represents a 
communication control unit, reference numeral 203 indi- 
cates a communication path between this control appa- 
ratus 1 05 and the network interface 1 1 6b, and reference 
numerals 204 and 205 show communication paths 
between this control apparatus 105 and the network 
interface 1 1 5a. 

[0044] The communication control unft 202 per- 
forms a basic control operation for communications 
between the terminal 106 and the service relaying 
apparatus 1 01 in accordance with a protocol used to 
establish a communication path, such as the communi- 
cation control method defined based upon the recom- 
mendation H. 245 of ITU-T. 

[0045] When the communication between the ter- 
minal 106 and the service relaying apparatus 101 is 
commenced, the communication control unit 202 
obtains the data display capability of the terminal 1 06 by 
exchanging the capability based upon the protocol used 
to establish the communication path, and stores the 
acquired data display capability into a storage device 
provided inside this communication control unit 202 for 
a time period until the communication is ended. After 
the communication between the terminal 106 and the 
service relaying apparatus 101 is established by the 
communication control apparatus 202, a major function 
of the control apparatus 105 is provided by the relay 
control unit 201. 

[0046] The relay control unit 201 directly converts 
the contents data 110, or converts this contents data 
110 into compressed moving picture data by properly 
referring to the data display capability of the terminal 
106 stored in the communication control unit 202, and 
then, transmits either the contents data 1 10 or the con- 
verted compressed moving picture data to the terminal 



106. 

[0047] When the contents data 110 saved in the 
service providing apparatus 109 is designated from the 
terminal 1 06, the relay control unit 201 derives the des- 

5 ignated contents data 110 from the service providing 
apparatus 109 via the communication path 203 and the 
network interfaces 1 1 6a and 1 1 6b. 
[0048] Next, if the contents viewing apparatus 1 08 
of the terminal 106 is capable of displaying all data of 

10 the designated contents data 1 1 0, then the relay control 
apparatus 201 refers to the data display capability of the 
terminal 106 stored in the communication control unit 
202, and directly transmits this designated contents 
data 1 10 via the communication path 204 to the termi- 

15 nal 1 06. 

[0049] When the contents viewing apparatus 1 08 of 
the terminal 106 cannot display all data of the desig- 
nated contents data 1 1 0, the relay control unit 201 con- 
trols both the reproducing apparatus 102 and the 

20 moving image coding apparatus 104 so as to convert 
the designated contents data 110 into compressed 
moving picture data, and then transmits the com- 
pressed moving picture data to the terminal 106. 
[0050] When the contents viewing apparatus 1 08 of 

25 the terminal 1 06 is capable of displaying portional data 
of the designated contents data 110, the relay control 
unit 201 prompts the terminal 106 to select the display 
method. 

[0051] In the case that the terminal 106 selects the 

30 display method by employing the contents viewing 
apparatus 108, the relay control unit 201 derives only 
such data displayable on the contents viewing appara- 
tus 108 from the designated contents data 110, and 
then sends the derived data to the terminal 1 06. 

35 [0052] In the case that the terminal 106 selects the 
display method by employing the moving picture repro- 
ducing apparatus 107, the relay control unit 201 con- 
verts the contents data 110 into compressed moving 
picture data, and then sends the compressed moving 

40 picture data to the terminal 1 06. 

[0053] Now, a description will be made of a process 
operation for converting the contents data 1 1 0 into the 
compressed moving picture data and for transmitting 
the compressed moving picture data to the terminal 

45 1 06. In this embodiment mode, the contents data 1 1 0 is 
assumed as still picture data with the JPEG (Joint Pho- 
tographic Experts Group) format, whereas the repro- 
ducing apparatus 102 is assumed as software capable 
of displaying still picture data with the JPEG format, 

50 which is operated on a general-purpose personal com- 
puter. 

[0054] The reproducing apparatus 1 02 derives the 
contents data 110 which is designated by the control 
signal 113 supplied from the relay control unit 201 pro- 
55 vided in the control apparatus 1 05, from the service pro- 
viding apparatus 109 via both the communication path 
112 and the network interfaces 116a and 116b. Then, 
the reproducing apparatus 102 displays the derived 



6 



11 EP10< 

contents data 1 1 0 on the image data relaying apparatus 
103. It should be understood that the expression "dis- 
play" implies the following fact. That is, the contents 
data 110 need not be actually displayed on a display 
unit, but the reproducing apparatus 102 transmits the 
contents data to an interface identical to a display unit 
(will be explained later). 

[0055] The moving picture coding apparatus 104 
derives still image data originated from the contents 
data 1 1 0 from the image data relaying apparatus 1 03 in 
response to the control signal 114 supplied from the 
relay control unit 201 provided in the control apparatus 
105, produces compressed moving picture data from 
the still picture data, and then sends the produced com- 
pressed moving picture data via the communication 
path 111 and the network interfaces 115a/1 15b to the 
terminal 106. 

[0056] In this case, both realizing means of the 
image data relaying apparatus 103 and operations 
thereof will now be explained. 

[0057] The image data relaying apparatus 1 03 in 
accordance with the present invention is required to sat- 
isfy the below-mentioned two conditions. 
[0058] As a first condition, the reproducing appara- 
tus 102 can utilize commercially available contents 
reproducing software, for instance, a commercially 
available software product. 

[0059] As one example, the contents data 1 1 0 used 
in this embodiment mode is still image data formed in 
the JPEG format. However, in an actual case, contents 
data having various sorts of formats may be handled as 
this contents data 110. For instance, a home page 
described by the HTML (Hyper Text Marking Lan- 
guage), and 3-dimensional computer graphics data 
described by the VRML (Virtual Reality Modeling Lan- 
guage) may be considered. 

[0060] To accept such various sorts of contents 
data 1 1 0, a plurality of reproducing functions equal to a 
total sort number of contents data 1 1 0 must be provided 
with the reproducing apparatus 102. In this case, as a 
means for realizing the reproductions of the contents 
data 1 10 formed in the various formats, when the com- 
mercially available contents reproducing software such 
as commercially available software products, the serv- 
ice relaying apparatus 101 may be easily realized in low 
cost. Also, the service relaying apparatus 101 may 
quickly accept contents data 110 formed in a new for- 
mat. 

[0061] As a second condition, the contents data 
110 displayed on the reproducing apparatus 102 is 
transmitted to the moving picture coding apparatus 104 
without lowering the image quality of this contents data 
110. 

[0062] The image data relaying apparatus 103 
according to this embodiment mode is realized by way 
of a video memory (will be referred to as a "V-RAM" 
hereinafter) employed in a general-purpose personal 
computer and the like. Since such a V-RAM is 
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employed, the image data relaying apparatus 103 may 
provide the same interface as that of data display on the 
display device to the reproducing apparatus 102. This 
display device may be realized by a CRT (cathode-ray 
5 tube) used in a general-purpose personal computer. In 
other words, sending of the data to this interface may be 
considered as "display". 

[0063] In addition, since an operating system (will 
be referred to as an "OS" hereinafter) generally used in 

10 a personal computer, for instance, "Windows-NT" mar- 
keted by Microsoft may provide a function capable of 
deriving data saved in a V-RAM with respect to an appli- 
cation program, the moving picture coding apparatus 
104 is capable of easily acquire the still image data orig- 

15 inated from the contents data 1 1 0 from the V-RAM by 
using this function. 

[0064] Since the image data relaying apparatus 103 
is realized by way of the V-RAM, the above-described 
two conditions can be satisfied without newly employing 

20 a special control program. In other words, since the still 
image data display software corresponding to the repro- 
ducing apparatus 102 displays the still picture on the 
display device such as a CRT (alternatively, data is sent 
to V-RAM, which can be equivalent^ recognized as 

25 "display" function), the still picture data originated from 
the contents data 1 10 can be transferred to the moving 
picture coding apparatus 104. 

[0065] Subsequently, the moving picture coding 
apparatus 104 will now be described. 

30 [0066] Fig. 3 represents an arrangement of the 
moving picture coding apparatus 104. In Fig. 3, refer- 
ence numeral 301 shows a data acquiring unit; refer- 
ence numeral 302 indicates a shared memory; 
reference numeral 303 represents a moving picture 

35 coding unit; reference numeral 304 indicates an opera- 
tion control information memory; reference numeral 305 
represents still image data supplied from the image data 
relaying apparatus 103; reference numeral 306 shows 
compressed moving image data; and reference numeral 

40 307 indicates a control signal. 

[0067] The moving picture coding apparatus 104 
according to this embodiment mode owns the following 
two features. 

[0068] A first feature is given as follows: That is, in 
45 such a case that still image data to be coded is changed 
like an animation while time has passed, this moving 
picture coding apparatus 1 04 performs the general-pur- 
posed moving picture coding operation. In the case that 
still picture data to be coded is not changed while time 
50 has passed like still picture data, the moving picture 
coding apparatus 1 04 performs the moving picture cod- 
ing operation by way of the stepwise image quality com- 
plementing process operation, so that the still image 
data having a high image quality can be decoded. 
55 [0069] A second feature is given as follows: The 
moving picture coding apparatus 104 adaptively 
changes a method for producing compressed moving 
picture data, for example, a filtering process operation 
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executed before a coding operation, depending upon a 
characteristic of still picture data to be coded by the 
moving picture coding operation, for example, charac- 
teristics of a character, a natural image, and computer 
graphics, so that compressed moving picture data hav- 
ing a high image quality can be produced. 
[0070] A description will now be made of operations 
of the moving image coding apparatus 104, and also 
means for realizing the above-described two features. 
(0071] The information used to define operations of 
the moving picture coding apparatus 104 is stored via 
the control signal 1 1 4 into the operation control informa- 
tion memory 304. In this embodiment mode, the infor- 
mation stored in the operation control information 
memory 304 is given as follows: 
[0072] A position of still picture data originated from 
the codable contents data 1 1 0 stored in the image data 
relaying apparatus 1 03, for example, an address of a 
pixel on the V-RAM at an upper left end of a rectangular 
area; 

a dimension of still picture data originated from the 
contents data 1 1 0, for instance, a total pixel number 
along a horizontal direction and a total pixel number 
along a vertical direction; 

a sort of still image data originated from the con- 
tents data 1 10, for example, a character, a natural 
image, computer graphics, and so on; 
a position of an area which is actually coded within 
the still picture data originated from the contents 
data 1 10, for example, an address of a pixel on the 
V-RAM at an upper left edge of a rectangular area; 
a dimension of an area which is actually coded 
within the still picture data originated from the con- 
tents data 110, for example, a total pixel number of 
a rectangular area along a horizontal direction and 
a total pixel number of the rectangular area along a 
vertical direction; 

a bit number of compressed moving picture data 
per unit time (bit rate); 

aframe number of compressed moving picture data 
per unit time (frame rate); 

resolution of compressed moving picture data; and 
a mode of a coding process operation, namely 
either a stepwise image quality complementing 
mode or a normal moving picture mode, an opera- 
tion permission flag of the moving picture coding 
apparatus 104, and so on. 

[0073] Fig. 4 is a schematic diagram for represent- 
ing a relationship among the respective areas stored in 
the operation control information memory 304. In Fig. 4, 
reference numeral 401 indicates a display memory area 
owned by the image data relaying apparatus 1 03; refer- 
ence numeral 402 indicates an origin of the memory 
area 401; reference numeral 403 is still picture data 
originated from the codable contents data 110 displayed 
on the image data relay apparatus 103; reference 



numeral 404 shows a typical point for specifying the 
position of the still picture data 403 originated from the 
contents data 110; reference numeral 405 indicates an 
area which is actually coded within the still picture data 

5 403 originated from the contents data 110; and refer- 
ence numeral 406 shows a typical point for specifying a 
position of an area 405 which is actually coded. 
[0074] Also, in Fig. 4, symbols Xm and Ym indicate 
a total pixel number of the display memory area 401 

10 along a lateral direction, and a total pixel number of this 
display memory area 401 along a longitudinal direction. 
[0075] Symbols Xd and Yd a total pixel number of 
the still picture data 403 along a lateral direction, and a 
total pixel number of this still picture data 403 along a 

15 longitudinal direction. 

[0076] Symbol (xdO, ydO) represents a position of 
the typical point 404 within the display memory area 
401. 

[0077] Symbols Xt and Yt show a total pixel nu mber 
20 of the coding area 405 along a lateral direction, and a 
total pixel number of this coding area 405 along a longi- 
tudinal direction. 

[0078] Symbol (xtO, ytO) represents a position of the 
typical point 406 within the display memory area 401 . 

25 [0079] Fig. 5 is a flow chart for representing opera- 
tions of the data acquiring unit 301 . 
[0080] In response to a timer provided inside the 
data acquiring unit 301, this data acquiring unit 301 
refers to the operation permission flag of the operation 

30 control information memory 304 every time a certain 
time period has passed (step 501). When the operation 
permission flag for permitting a production of com- 
pressed moving picture data is valid (step 502), the data 
acquiring unit 301 acquires still picture data from the 

35 image data relaying apparatus 103 based upon infor- 
mation related to still picture data to be coded which is 
stored in the operation control information memory 304 
(step 503). 

[0081] Next, the data acquiring unit 301 performs 
40 either the enlarging process operation or the compress- 
ing process operation with respect to the acquired still 
picture data based on the dimension/sort of the still 
image data stored in the operation control information 
memory 304, and the information related to the resolu- 
45 tion of the compressed moving picture data, and then 
produces still picture data having predetermined resolu- 
tion. Furthermore, the data acquiring unit 301 executes 
the filtering process operation in response to the sort of 
the still picture data, 'rf necessary, and thus, performs 
50 the pre-process operation in order to acquire com- 
pressed moving picture data having a high image qual- 
ity. 

[0082] After such a process operation is carried out, 
the data acquiring unit 301 stores the resultant still pic- 
55 ture data into the shared memory 302 (step 503), 
instructs the moving picture coding unit 303 to com- 
mence the coding process operation (step 504), and 
then waits that the coding process operation by the 
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moving picture coding unit 303 is accomplished (step 
505). 

[0083] When the data acquiring unit 301 detects 
that the coding process operation by the moving picture 
coding unit 303 is accomplished, in the case that the 
operation mode corresponds to the stepwise image 
quality complementing mode, this data acquiring unit 
301 invalidates the operation permission flag of the 
operation control information memory 304 (step 506), 
and thereafter, again commences the process operation 
defined at the step 501 in response to the timer opera- 
tion. 

[0084] In such a case that the coding process mode 
saved in the operation control information memory 304, 
the timer produces a signal in such a manner that a time 
period required for a series of process operations 
(defined from step 501 to step 505) executed by the 
data acquiring unit 301 is made coincident with the 
frame rate of the compressed moving picture data 
stored in the operation control information memory 504. 
In this case, the moving picture coding unit 303 pro- 
duces/outputs video data of 1 frame every 1 time 
period. In other words, the frame rate of the com- 
pressed moving picture data is maintained by the data 
acquiring unit 301. 

[0085] On the other hand, in the case that the cod- 
ing process operation mode stored in the operation con- 
trol information memory 304 corresponds to the 
stepwise image quality complementing mode, while the 
moving picture coding unit 303 maintains the frame rate 
of the compressed moving picture data stored in the 
operation control information memory 304, a plurality of 
frame data is produced by executing a stepwise image 
quality complementary type coding process operation. 
[0086] Upon receipt of a process starting instruction 
issued from the data acquiring unit 301 , the moving pic- 
ture coding unit 303 produces/outputs desirable com- 
pressed moving picture data 306 with reference to such 
information related to a bit rate, a frame rate, and reso- 
lution of the compressed moving picture data stored in 
the operation control information memory 304. When 
the coding process operation is ended, the moving pic- 
ture coding unit 303 notifies the completion of this cod- 
ing process operation via the control signal 307 to the 
data acquiring unit 301 . 

[0087] When the coding process operation mode 
corresponds to the normal moving picture mode, the 
moving picture coding unit 303 performs the general- 
purpose moving picture coding operation. It should be 
understood that "general-purpose moving picture cod- 
ing operation" implies a method of combining the intra 
frame coding method with the inter frame prediction 
coding method, for example, MPEG-1 type compressed 
moving picture data (Moving Picture Image Coding 
Experts Group-1 : ISO/IEC 1 1 1 72). 
[0088] One of the features achieved in this embodi- 
ment mode is the coding operation of the moving picture 
coding unit 303 in such a case that the coding process 



mode corresponds to the stepwise image quality com- 
plementing mode. Figs. 6A and 6B are conceptional 
diagrams for explaining the stepwise image quality com- 
plementary type coding process operation. Precisely 

5 speaking, Fig. 6A is a conceptional diagram for showing 
the moving picture coding process operation executed 
in the general MPEG-1 type coding process operation. 
Fig. 6B is a conceptional diagram for representing the 
stepwise image quality complementary type coding 

jo process operation. 

[0089] In Fig. 6A, reference numerals 601, 602, 603 
indicate non-compressed picture frames; reference 
numerals 604, 605, 606 represent compressed picture 
frames; and reference numerals 607, 608, 609 show 

15 reference picture frames. 

[0090] In Fig. 6B, reference numerals 61 0, 61 1 , 61 2 
indicate non-compressed picture frames; reference 
numerals 613, 614, 615 represent compressed picture 
frames; and reference numerals 616, 617, 618 show 

so reference picture frames. 

[0091] In both Fig. 6A and Fig. 6B, the coding proc- 
ess operations are advanced from the left hand to the 
right hand while time has elapsed. 
[0092] First, referring now to Fig. 6A, the moving 

25 picture coding process operation generally executed in 
the MPEG-1 type coding process operation will be sum- 
marized. 

[0093] In the coding process operation with respect 
to the non-compressed image frame 601, the intra 

30 frame coding operation arranged by the discrete cosine 
transform (DCT) and the quantization is carried out. As 
a result, the compressed picture frame 604 is obtained. 
Next, the coding process operation is advanced to the 
non-compressed picture frame 602. As the coding oper- 

35 ation of the non-compressed picture frame 602, the 
inter frame prediction coding operation is carried out. In 
this coding operation, a reference picture frame is 
required so as to perform a motion compensation proc- 
ess operation. In this case, as this reference picture 

40 frame, the reference picture frame 607 is employed 
which is produced from the previously acquired com- 
pressed picture frame 604. The motion compensation 
process operation is carried out between the non-com- 
pressed picture frame 602 and the reference picture 

45 frame 607 to thereby obtain the compressed picture 
frame 605. Next, the coding operation is advanced to 
the non-compressed picture frame 603. Similarly, when 
the non-compressed picture frame 603 is coded, the 
inter frame prediction coding operation is carried out. In 

50 this case, as this reference picture frame, the reference 
picture frame 608 is employed which is produced from 
the previously acquired compressed picture frame 605 
and the reference picture frame 607. The motion com- 
pensation process operation is carried out between the 

55 non-compressed picture frame 603 and the reference 
picture frame 608 to thereby obtain the compressed pic- 
ture frame 606. Subsequently, similar coding operations 
are repeatedly carried out. 
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[0094] Next, the stepwise image quality comple- 
mentary type coding process operation will now be 
summarized with reference to Fig. 6B. 
[0095] A major operation of this stepwise image 
quality complementary type coding process operation is 5 
identical to the moving picture coding process operation 
generally executed in the MPEG-1 type coding process 
operation. However, this stepwise image quality com- 
plementary type coding process operation owns such a 
different point, namely a non-compressed picture frame 10 
and a quantizing step value. When the coding process 
operation with respect to the non-compressed image 
frame 610, the intra frame coding operation is carried 
out, so that the compressed picture frame 613 is 
obtained. At this time, in order to reduce the data 15 
amount of the compressed image frame 613, a coarse 
(large) quantizing step value is employed. 
[0096] Next, the coding operation is advanced to 
the non-compressed picture frame 611 Since the step- 
wise image quality complementary type coding process 20 
operation is directed to such data having no temporal 
change such as still picture data, as the non-com- 
pressed picture frame 61 1 employed in this coding proc- 
ess operation, the same data as the non-compressed 
picture frame 61 0 is employed. This is one of the differ- 25 
ent points in comparison with the moving picture coding 
process operation generally executed in the MPEG-1 
type coding operation. As the coding operation of the 
non-compressed picture frame 61 1 , the inter frame pre- 
diction coding operation is carried out. In this coding 30 
operation, a reference picture frame is required so as to 
perform a motion compensation process operation. In 
this case, as this reference picture frame, the reference 
picture frame 616 is employed which is produced from 
the previously acqu ired compressed picture frame 61 3. 35 
The motion compensation process operation is carried 
out between the non-compressed picture frame 611 
and the reference picture frame 616 to thereby obtain 
the compressed picture frame 61 4. Since the same data 
as the non-compressed picture frame 610 is employed 40 
as the non-compressed picture frame 61 1 , it is already 
known that a motion vector between the non-com- 
pressed picture frame 611 and the reference picture 
frame 616 is zero. As a result, no search is made of the 
motion vector, but the quantizing process operation is 4i 
carried out with respect to a difference between the 
non-compressed picture frame 611 and the reference 
picture frame 616. At this time, as a quantizing step 
value, a fine (small) quantizing step value is used, as 
compared with the above-explained quantizing step S 
value used when the compressed picture frame 1 3 is 
produced. As a result, it is possible to obtain such a 
non-compressed picture frame 614 having more pre- 
cise information than that of the compressed picture 
frame 613. 5 
[0097] Next, the coding process operation is 
advanced to the non-compressed picture frame 612. 
When the non-compressed picture frame 61 2 is coded, 



the inter frame prediction coding operation is similarly 
carried out. In this case, as this reference picture frame, 
the reference picture frame 617 is employed which is 
produced from the previously acquired compressed pic- 
ture frame 614 and the reference picture frame 616. The 
non-compressed picture frame 61 0 is also the same as 
the non-compressed picture frame 612, and a similar 
coding process operation is carried out when the com- 
pressed picture frame 614 is produced, so that the com- 
pressed picture frame 615 is obtained. It should be 
noted that as a quantizing step value, a more precise 
(smaller) quantizing step value is employed, as com- 
pared with that used to previously obtain the com- 
pressed picture frame 61 4. As a result, this compressed 
picture frame 61 5 may become such a compressed pic- 
ture frame having more precise information, as com- 
pared with that of the previously acquired compressed 
picture frame 61 4. 

[0098] Subsequently, while the quantizing step 
value is gradually made finer (smaller), a similar coding 
process operation is repeatedly carried out. At such a 
time instant when the quantizing step value may 
become sufficiently precise, this coding process opera- 
tion is accomplished. 

[0099] A description will now be made of such a 
condition that the image quality is gradually improved in 
the stepwise image quality complementary type coding 
process operation by employing formulae. Fig. 7 
describes a series of formulae. It should be noted that 
expressions of the respective items shown in Fig. 7 are 
originated from Fig. 6B. 

[0100] A reproduced picture frame F1 obtained 
from the first compressed picture frame 613 may be 
expressed by way of a formula 1. In this formula 1 , sym- 
bol "x1" indicates a deterioration component of an 
image quality caused by a quantizing error, and symbol 
"R1" shows the reference picture frame 616. Precisely 
speaking, since the reproduced picture frame F1 and 
the reference picture frame R1 are processed by way of 
the decoding process such as the inverse DCT process 
in the different apparatuses, this reproduced picture 
frame F1 is not made equal to this reference picture 
frame R1 . However, since a difference between the 
reproduced picture frame F1 and the reference picture 
: frame R1 gives no adverse influence to the essential 
point of this formula explanation, this difference is 
neglected. This fact may be similarly applied to a rela- 
tionship between a reproduced picture frame F2 and the 
reference picture frame R2. 
' [0101] The second compressed picture frame 614, 
namely "P1" shown in Fig. 7 may be expressed by a for- 
mula 2. Symbol "x2" indicates a deterioration compo- 
nent of an image quality caused by a quantizing error. A 
reproduced picture frame F2 obtained from the second 
> compressed picture frame 61 4 may be expressed by a 
formula 3. 

[0102] The third compressed picture frame 615, 
namely "P2" shown in Fig. 7 may be expressed by afor- 
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mula 4. Symbol "x3" indicates a deterioration compo- 
nent of an image quality caused by a quantizing error. A 
reproduced picture frame F3 obtained from the third 
compressed picture frame 615 may be expressed by a 
formula 5. 5 
[0103] Since the quantizing step values employed 
when the respective compressed picture frames are 
produced are gradually made finer (smaller), the deteri- 
oration components x1, x2, x3 of the image quality 
caused by the respective quantizing errors may be io 
expressed by such a relationship of a formula 6. As a 
consequence, the quantizing error occurred when the 
quantizing step value becomes sufficiently finest (small- 
est ) is negligible. As a result, the image quality of the 
resulting reproduced picture frame is extremely approx- 15 
imated to the non-compressed image frame 61 0. 
[0104] In addition, as to the data amounts of the 
compressed picture frames 614 and 615 obtained by 
executing the inter frame prediction coding operation, 
since the quantizing step value is properly selected, 20 
these data amounts may be controlled so as to obtain 
desirable bit rates. 

[0105] Since the still picture data is converted into 
the compressed moving picture data by employing the 
above explained method, the image quality of the con- 25 
verted compressed moving picture data can be made 
very close to the image quality of the original picture. 
[0106] All of the information stored in the operation 
control information memory 304 may be rewritten at an 
arbitrary time instant via the control signal 1 1 4. Both the 30 
data acquiring unit 301 and the moving picture coding 
unit 303 acquire the information stored in the operation 
control information memory 304 every time one unit of 
the process operation is carried out, and may change a 
detailed process operation based upon this acquired 35 
information. 

[0107] Next, a description will now be made of a 
method for displaying partial data of the contents data 
1 10 in an enlarge manner. 

[0108] Fig. 8 illustratively represents a structure of 40 
the operation button 117 of the terminal 106. In Fig. 8, 
reference numeral 801 shows a direction button for 
instructing upper-lower-right-left directions, reference 
numeral 802 shows a menu button, and reference 
numeral 803 indicates a start button. Also, reference 45 
numeral 804 denotes a clear button, reference numeral 
805 is an end button, and reference numeral 806 repre- 
sents a dial button constituted by numerals "0" to "9", a 
symbol "*", and another symbol "#". When the respec- 
tive buttons are depressed, signals are produced in cor- so 
respondence with the respective button. 
[0109] Fig. 9 is a display example of a still picture 
equal to the contents data 111 in the terminal 106. In 
Fig. 9, reference numeral 901 shows a rectangular 
frame indicative of an area which is displayed in an 55 
enlarge manner, reference numeral 902 represents a 
rectangular frame indicative of a first desirable area 
which is displayed in an enlarge manner, and reference 



numeral 903 shows a rectangular frame indicative of a 
second desirable area which is displayed in an enlarge 

[0110] Referring now to Figs. 9A to 9G, a descrip- 
tion will be made of a button operation example and a 
display condition example in the case that partial data of 
the contents data 110 is displayed in an enlarge man- 
ner. 

[0111] Fig. 9A shows an example in such a case 
that the contents data 110 (namely, will picture in this 
embodiment) stored in the service providing apparatus 
109 is displayed in an original size. 
[0112] Fig. 9B indicates an entire area of the con- 
tents data 1 1 0 displayed on the display unit of the termi- 
nal 106. In other words, the entire area of the still picture 
is reduced in correspondence with the dimension of the 
display unit of the terminal 106 to be displayed thereon. 
In this embodiment mode, it is assumed that this condi- 
tion is an initial condition of the still picture display. 
[0113] Fig. 9C shows a display condition estab- 
lished just after the direction button 801 is depressed to 
designate any one of the upper-lower-right-left direction 
after the initial condition. Reference numeral 901 is a 
rectangular frame indicative of an area which is dis- 
played in an enlarge manner. This rectangular frame 
901 is automatically deleted in such a case that after the 
direction button 801 is depressed, either this direction 
button 801 is not further depressed or the start button 
803 is not depressed for a preselected time period, for 
example, 3 seconds. The display and the deletion of the 
rectangular frame are performed by the terminal 106 
itself in response to the depression of the operation but- 
ton 117. 

[0114] Fig. 9D indicates such a display condition 
that after the direction button 801 is depressed to dis- 
play the rectangular frame 901 , the direction button 801 
is subsequently depressed arbitrary times to move this 
rectangular frame 901 to the desirable are 902 to be 
enlarged. 

[0115] Fig. 9E shows such a display condition that 
the area 902 to be enlarged is designated by the rectan- 
gular frame 901, and this area 902 is displayed in an 
enlarge manner by depressing the start button 803. 
[0116] Fig. 9F shows such a display condition that 
the direction button 801 is further depressed to display 
the rectangular frame 901, and the desirable display 
area 903 to be enlarged is designated. 
[0117] Fig. 9G indicates such a display condition 
that the display area 903 is displayed in an enlarge 
manner. 

[01 18] A portion of the contents data 1 1 0 displayed 
on the terminal 106 is displayed in an enlarge manner 
by performing the above-explained button operation. 
[01 1 9] Subsequently, a means for realizing such an 
enlarging display will now be explained. 
[0120] After the direction button 801 is depressed 
arbitrary times from the initial condition as shown in Fig. 
9(b) so as to designate a desirable display area to be 



11 



21 EP 1 049 305 A1 22 



enlarged, when the start button 803 is depressed, the 
moving picture reproducing apparatus 107 sends a 
position and a size of a designated area on the display 
device of the terminal 1 06 to the relay control unit 201 . 
[0121] The relay control unit 201 calculates a posi- 
tion and a size of such an area of the contents data 1 1 0, 
which is newly coded, based upon both the position/size 
of the designated area supplied from the terminal 106. 
Then, the relay control unit 201 updates the relevant 
information stored in the operation control information 
memory 304, namely the position/size of the area which 
is actually coded within the bit map data, and further- 
more, valids the operation permission flag. 
[0122] The moving picture coding apparatus 104 
produces new compressed moving picture data in 
accordance wfth this updated information of the opera- 
tion control information memory 304. As a result, the 
terminal 1 06 can enlarge the desirable display area. 
[0123] It should also be noted that the format of the 
compressed moving picture data which may be handled 
by the moving picture coding apparatus 104 and the 
moving picture reproducing apparatus 107, according to 
this embodiment mode, is assumed by the standardiza- 
tion of the MPEG-4 standard (I SO/I EC 14496). Alterna- 
tively, the moving picture coding apparatus 104 and the 
moving picture reproducing apparatus 107 may utilize 
such compressed moving picture data which is obtained 
by the coding system made by combining the intra 
frame coding system with the inter frame prediction cod- 
ing system, for instance, MPEG-1 (ISO/IEC 11172), 
MPEG-2 (ISO/IEC 13818), and recommendation H.261 
and H.263 of ITU-T. 

[0124] Also, in the image data relaying apparatus 
103 according to this embodiment mode, the video 
memory (V-RAM) may be replaced by a semiconductor 
memory such as a DRAM, and also a storage apparatus 
such as a magnetic disk apparatus. Fig. 10 is a struc- 
tural diagram of an image data relaying apparatus with 
employment of a semiconductor memory such as a 
DRAM. 

[0125] In Fig. 10, reference numeral 1001 shows a 
write control unit, reference numeral 1002 indicates a 
read control unit, reference numerals 1003 and 1004 
represent memories separately provided from each 
other, and reference numeral 1005 shows a shared 
memory. Also, reference numeral 1006 indicates a sig- 
nal line used to still picture data originated from the con- 
tents data 1 10 supplied from the reproducing apparatus 
102, and reference numeral 1007 shows a signal line 
used to still picture data originated from the contents 
data 110 sent to the moving picture coding apparatus 
104. 

[0126] The shared memory 1005 stores thereinto 
use conditions of the memory 1003 and of the memory 

1004 at the present time instant. This shared memory 

1005 can be read/written by both the write control unit 
1001 and the read control unit 1002. 

[0127] The write control unit 1001 recognizes such 



a memory (either memory 1003 or memory 1004) into 
which the still picture data can be written by referring to 
the shared memory 1005, and then writes the still pic- 
ture data derived from the reproducing apparatus 102 

5 via the signal line 1006 into this recognized memory. 
[0128] The read control unit 1002 recognizes such 
a memory (either memory 1003 or memory 1004) into 
which the latest readable still picture data is stored by 
referring to the shared memory 1005, and reads the still 

10 picture data from this recognized memory, and then, 
transfers the read still picture data via the signal line 
1 007 to the moving picture coding apparatus. 
[0129] The write control unit may provide such an 
interface that this interface may functions as a display 

15 apparatus such as a video memory with respect to the 
reproducing apparatus 102. As a consequence, a com- 
mercially available still picture display unit may be used 
as the reproducing apparatus 102. 
[0130] It should also be understood that the picture 

20 data relaying apparatus 1 03 may be realized by employ- 
ing only one of the memory 1 003 and the memory 1004 
shown in Fig 10. Alternatively, this picture data relaying 
apparatus 1 03 may be realized by employing more than 
3 sets of memorys having similar functions to the func- 

25 tion of either the memory 1003 or the memory 1004 
indicated in Fig. 10. 

[0131] As previously explained, in accordance with 
this embodiment mode, since the contents data saved 
in the service providing apparatus 109, namely the still 

so picture data formatted by the JPEG system is converted 
into the compressed moving picture data by the service 
relaying apparatus 101, this still picture can be dis- 
played by employing the terminal 106 which does not 
have the still picture display function. 

35 [0132] Also, since the compressed moving picture 
data is produced by the stepwise image quality comple- 
menting method, the still picture can be displayed with 
having the high image quality substantially equal to the 
original image quality, namely, similar image qualities as 

40 that of the acquired contents data 110 is repro- 
duced/transferred by the reproducing apparatus 102. 
Also, since the data amount of this compressed moving 
picture data is smaller than that of the JPEG type still 
image data, it is possible to shorten the waiting time for 

45 the completion of the data transfer operation, and the 
contents data can be quickly displayed on the terminal 
106. 

[0133] Furthermore, since the video memory (V- 
RAM) is employed in the image data relaying apparatus 

so 1 03, the commercially available still picture display soft- 
ware such as a commercial software product can be uti- 
lized, and also such a service relaying apparatus 101 
adapted to various data formatted contents data 110 
can be readily realized. Also, since such a semiconduc- 

55 tor memory as a DRAM is employed in the image data 
relaying apparatus 103, the display memory area 401 
can be increased as compared with that achieved when 
the V-RAM is used. As a result, contents data having 
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larger capacities can be displayed, which may improve 
practical merits. 

[EMBODIMENT 2] 

5 

[0134] A second embodiment mode of the present 
invention will now be described with reference to Fig. 1 1 
to Fig. 15. 

[0135] Fig. 11 represents a structural diagram of 
the second embodiment mode. In Fig. 11, reference 10 
numeral 1101 shows a service relaying apparatus; ref- 
erence numeral 1102 shows a reproducing apparatus; 
and reference numeral 1103 is a control apparatus. 
Also, reference numeral 1104 shows a control signal of 
the reproducing apparatus 1 1 02. Other structural ele- 15 
ments of the second embodiment mode are identical to 
those of the first embodiment mode. A major different 
point between the arrangement of the second embodi- 
ment mode and the arrangement of the first embodi- 
ment mode is both the reproducing apparatus 1 102 and 20 
the control apparatus 11 03 in the service relaying appa- 
ratus 1101. 

[0136] First, a description will now be made of usa- 
ble modes directed to this embodiment mode. 
[0137] Although the terminal 106 is identical to the 25 
terminal 106 employed in the first embodiment mode, 
the contents data 110 displayed on this terminal 106 is 
different from each other. The contents data 110 
expected in the second embodiment mode is a home 
page described by the HTML (Hyper Text Markup Lan- 30 
guage), and is constituted by character data and still 
picture data. When such a contents data 110 is dis- 
played on the terminal 1 06, then entire area of the con- 
tents data 110 is first compressed and then, the 
compressed contents data is displayed. As apparent 35 
from the foregoing description, the entire image of the 
contents data displayed on the terminal 106 owns low 
visibility as to very small areas thereof. As a result, an 
arbitrary partial portion of the contents data 110 is 
enlarged by arbitrarily setting magnification by manipu- 40 
latingthe operation button 1 17 equipped on the terminal 
106 so as to display a detailed portion of this contents 
data 110. In addition, a home page under display is 
moved along upper/lower/right/left directions, and also 
other home pages related to the first-mentioned home 45 
page by an URL (Universal Resource Locator) are 
selected/displayed by the operation button 1 1 7. 
[0138] Next, a description will be made of both 
operations of this embodiment mode and realizing 
means thereof. so 
[0139] As the reproducing apparatus 1102, home 
page viewing software generally operated on personal 
computers, for example, "Internet Explorer" of Microsoft 
corporation is used. 

[0140] Next, the control apparatus 11 03 will now be 55 
explained. Fig. 12 shows an arrangement of the control 
apparatus 1103. In Fig. 12, reference numeral 1201 
indicates a relay control unit, reference numeral 1202 



indicates a communication path between this control 
apparatus 1103 and the network interface 116b, and 
reference numeral 1203 shows a communication path 
between this control apparatus 1103 and the network 
interface 115b. Other structural elements of the second 
embodiment mode are identical to those of the control 
apparatus 1 05 according to the first embodiment mode. 
[0141] The communication control unit 202 per- 
forms a basic control operation for communication 
between the terminal 106 and the service relaying 
apparatus 1101. After the communication between the 
terminal 106 and the service relaying apparatus 1 101 is 
established by the communication control unit 202, a 
major function of the control apparatus 1 1 03 is provided 
by the relay control unit 1201. Similar to the above- 
explained first embodiment mode, the relay control unit 
1201 selects data to be sent to the terminal 106, namely 
selects either character data or compressed moving 
picture data. 

[0142] Now, a description will be made of a process 
operation for converting the contents data 110 into the 
compressed moving picture data and for transmitting 
the compressed moving picture data to the terminal 
106. 

[0143] The reproducing apparatus 1 102 derives the 
contents data 110 which is designated by the control 
signal 1104 supplied from the relay control unit 1201 
provided in the control apparatus 1 1 03, from the service 
providing apparatus 109 via both the communication 
path 112 and the network interfaces 116a and 116b. 
Then, the reproducing apparatus 1102 displays the 
derived contents data 11 0 on the image data relaying 
apparatus 103. 

[0144] The moving picture coding apparatus 104 
derives still image data originated from the contents 
data 1 1 0 from the image data relaying apparatus 103 in 
response to the control signal 1 1 4 supplied from the 
relay control unit 1201 provided in the control apparatus 
1103, produces compressed moving picture data from 
the still picture data, and then sends the produced com- 
pressed moving picture data via the communication 
path 111 and the network interfaces 115a/115b to the 
terminal 106. 

[01 45] As a major display operation executed by the 
terminal 106 according to the second embodiment 
mode with respect to the contents data 110, namely, the 
home page described by the HTML, the entire area of 
the contents data 1 1 0 is displayed and an arbitrary data 
portion thereof are displayed in an enlarge manner; the 
contents data 110 is moved along the 
upper/lower/right/left directions (scroll display); and the 
display content of the contents data 110 is changed 
based upon the link information (URL) contained in the 
content data 1 1 0. 

[0146] Next, operations for performing various dis- 
play operations and realizing means thereof according 
to this embodiment mode will now be described. 
[01 47] Since both the entire display of the contents 
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data 1 1 0 and the arbitrary partial data portion displayed 
in the enlarge manner are the same display method for 
the contents data 1 1 0 described in the first embodiment 
mode, descriptions thereof are omitted. 
[0148] A description will now be made of operations 
and realizing means, according to this embodiment 
mode, for moving the contents data 110 along the 
upper/lower/right/left directions. 

[0149] The relay control unit 1201 saves such infor- 
mation related to the contents data 1 1 0 which has been 
stored in the operation control information memory 304 
employed inthe moving picture coding apparatus 104 in 
an internal storage unit (not shown in detail) thereof. In 
other words, this relay control unit 1201 saves; 

a position (xdO, ydO) and a dimension (Xd, Yd) of 
the codable still picture data 403 stored in the pic- 
ture data relaying apparatus 1 03, and a position 
(xtO, ytO) and a dimension (Xt, Yt) of the area 405 
which is actually coded within the still picture data 
403; and in addition, 

a total pixel number indicative of 1 move unit of the 

reproducing apparatus 1102 along the 

upper/lower/right/left directions; 

a position of a pointing cursol within the area 405; 

and 

a total pixel number indicative of 1 move unit of the 
pointing cursor. 

[0150] When a direction button 801 is depressed in 
the terminal 106 whose operation mode is set to "scroll 
operation", the moving picture reproducing apparatus 
107 produces a direction signal which implies a desig- 
nation direction, and then sends this direction signal via 
the network interfaces 115a/115b and the communica- 
tion path 1 1 1 to the relay control unit 1 201 employed in 
the service relaying apparatus 1 1 01 . The terminal 1 06 
produces this direction signal and sends the produced 
direction signal to the service relaying apparatus 1101 
every time the direction button 801 is depressed. 
[0151] Upon receipt of this direction signal, the 
relay control unit 1201 executes a process operation as 
indicated in Fig. 1 3. As a result, the moving picture cod- 
ing apparatus 1103 converts a designated area of the 
contents data 110 into compressed moving picture 
data, and sends this compressed moving picture data to 
the terminal 1 06. 

[0152] Referring now to Fig. 13, operations of the 
relay control unit 1201 will be explained. 
[0153] Upon receipt of the direction signal sent from 
the terminal 1 06 (step 1 301 ), the relay control unit 1 201 
sets the operation mode stored in the operation control 
information memory 304 to the normal moving picture 
mode, and valids the operation permission flag (step 
1302), and also calculates such a position (Xt, Yt) that 
the area 405 is moved by 1 move unit along the desig- 
nated direction (step 1303). 

[0154] When a new position of the area 405 is 



located in the area 403 (step 1304), the relay control 
unit 1 201 rewrites a position of an area which is actually 
coded in the still picture data by the position calculated 
at the step 1303 (step 1305), and then waits to receive 

5 a new direction signal (step 1 301 ). 

[0155] In such a case that the new position of the 
area 405 exceeds the area 403 (step 1304), the relay 
control unit 1201 sends the control signal 1104 to the 
reproducing apparatus 1 102 so as to move the position 

w of the area 403 by 1 move unit along the designated 
direction (step 1306), and then waits to receive a new 
direction signal (step 1301). 

[0156] When the direction signal is not received 
(step 1301), the relay control unit 1201 increases the 

15 reception waiting time of the direction signal by 1 unit 
time (step 1307). When this reception waiting time 
exceeds a preselected threshold value (step 1 308), the 
relay control unit 1201 sets the operation mode stored 
in the operation control information memory 304 to the 

20 stepwise image quality complementing mode, and 
valids the operation permission flag (step 1309), and 
waits to receive a new direction signal (step 1 301 ). With 
execution of this process operation, the moving picture 
coding apparatus 104, according to this embodiment 

25 mode, automatically sends the contents data 1 1 0 hav- 
ing the high image quality to the terminal 1 06 when the 
reception waiting time of the direction signal exceeds 
predetermined time, and then stops the process opera- 
tion. 

30 [0157] A description will now be made of operations 
and realizing means, according to this embodiment 
mode, which changes displaying of the contents data 
110 based on link information (URL) stored in the con- 
tents data 110. 

35 [0158] The terminal 1 06 designates link information 
contained in the contents data 1 10 by using a pointing 
cursor in order to change the display of this contents 
data 1 1 0. The pointing cursor provides a similar function 
to that of a mouse cursol used in a personal computer. 

40 This pointing cursor is displayed on the display unit of 
the terminal 1 06 with the contents data 1 1 0 at the same 
time. The terminal 1 06 itself displays the pointing cursor 
on the display unit, and also moves the pointing cursor 
in response to the depressing operation of the direction 

45 button 801 . 

[0159] When the direction button 801 is depressed 
under such a condition that the pointing cursor is dis- 
played on the terminal 1 06, the pointing cursor is moved 
by a preselected move unit along a designated direc- 

50 tion, and the terminal 1 06 transfers both the move direc- 
tion and the move amount of this pointing cursor via the 
network interfaces 115a/115b and the communication 
path 1 1 1 to the relay control unit 1 201 . 
[0160] Fig. 14 shows an operation flow for describ- 

55 ing the relay control unit 1201 related to the movement 
of the pointing cursor. 

[0161] Upon receipt of the signal related to the 
pointing cursor movement sent from the terminal 106 
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(step 1401), the relay control unit 1201 sets the opera- 
tion mode stored in the operation control information 
memory 304 to the normal moving picture mode, and 
valids the operation permission flag (step 1402), and 
also calculates such a new position of the pointing cur- 
sor based upon such information saved in the own relay 
control unit 1201 (step 1403). In other words, this infor- 
mation is related to the position of the area 403, the 
position of the area 405, the position of this pointing cur- 
sor within the area 405, a total pixel number indicative of 
one move unit of this pointing cursor, and the informa- 
tion related to the pointing cursor movement sent from 
the terminal 106 (namely, both move direction and move 
amount of pointing cursor). 

[0162] The position of this pointing cursor within the is I 0169 ] 
area 401 may be calculated by adding xdO + xtO, and ' 
ydO + ytO to the position of the pointing cursor within the 
area 405 along an X-axis direction and a Y-axis direc- 



[0168] Upon receipt of such a signal implying that a 
selection of link information is defined (step 1501), the 
relay control unit 1201 sets the operation mode stored 
in the operation control information memory 304 to the 
normal moving picture mode, and also valids the opera- 
tion permission flag (step 1502). When a left button of 
the mouse is depressed, the relay control unit 1201 
sends a similar signal by way of the control signal 1 104 
to the reproducing apparatus 1201 (step 1503). As a 
result, the new contents data 110 related to the link 
information is displayed by the reproducing apparatus 
1201 on the image data relaying apparatus 103, so that 
this new contents data 110 may be newly displayed on 
the terminal 106. 

When the definition signal is not received 
(step 1501), the relay control unit 1201 increases the 
reception waiting time of the definition signal by 1 unit 
time (step 1504). When this reception waiting time 
exceeds a preselected threshold value (step 1505), the 



is located within the area 403 (step 1404), the relay con- 
trol unit 1201 sends the control signal 1 1 04 to the repro- 
ducing apparatus 1 102 so as to update the position of 
the pointing cursor on the reproducing apparatus 1 102 
(step 1405). 

[0164] When the new position of the pointing cursor 
is not located within the area 403 (step 1404), the relay 
control unit 1 201 moves the contents data 1 1 0 along the 
move direction of the pointing cursor (step 1406), and 
thereafter, executes the process operation defined at 
the step 1405. 

[0165] When the move signal is not received (step 
1401), the relay control unit 1201 increases the recep- 
tion waiting time of the move signal by 1 unit time (step 
1407). When this reception waiting time exceeds a 
preselected threshold value (step 1408), the relay con- 
trol unit 1201 sets the operation mode stored in the 
operation control information memory 304 to the step- 
wise image quality complementing mode, and valids the 
operation permission flag (step 1409), and waits to 
receive a new move signal (step 1401). With execution 
of this process operation, the moving picture coding 
apparatus 104, according to this embodiment mode, 
automatically sends the contents data 110 having the 



in the operation control information memory 304 to the 
stepwise image quality complementing mode, and 
valids the operation permission flag (step 1506), and 
waits to receive a new definition signal (step 1 501 ). With 
execution of this process operation, the moving picture 
coding apparatus 104, according to this embodiment 
mode, automatically sends the contents data 110 hav- 
ing the high image quality to the terminal 1 06 when the 
reception waiting time of the direction signal exceeds 
predetermined time, and then stops the process opera- 
tion. 

[0170] Next, a description will now be made of a 
change in display conditions of the reproducing appara- 
tus 1102 in response to the control signal 1104, for 
example, a displayed content is moved along the 
upper/lower/right/left directions, and also link informa- 
tion is selected by the pointing cursor and a displayed 
content thereof is changed by the pointing cursor. 
[0171] In this embodiment mode, it is now assumed 
that both the reproducing apparatus 1 102 and the con- 
trol apparatus 1103 are operated under the same oper- 
ating system (OS), and constitute an execution unit of a 
program called as a "process", respectively. 
[0172] As previously explained, in response to the 



tion waiting time of the move signal exceeds predeter- 
mined time, and then stops the process operation. 
[0166] After the pointing cursor is moved to a posi- 
tion of desirable link information in the terminal 106, 
when the start button 803 is depressed which implies 
such a fact that the selection of this link information is 
defined, the terminal 106 transfers the definition of the 
link information selection via the network interfaces 
1 1 5a/1 1 5b and the communication path 1 1 1 to the relay 
control unit 1201. 

[0167] Fig. 1 5 is an operation flow for explaining a 
definition of selected link information by the relay control 
unit 1201. 



control unit 1201 employed ii 
1103 produces the control signal 1104 and then sends 
this control signal 1104 to the reproducing apparatus 
1 1 02. This control signal 1 1 04 instructs the reproducing 
apparatus 1 1 02 to change the display condition thereof. 
At this time, the control signal 1 104 owns the same con- 
tent as that of an event signal which is produced by 
depressing a keyboard and by manipulating a mouse in 
the reproducing apparatus 1102. The relay control unit 
1 201 transmits this control signal 1 1 04 to the reproduc- 
ing apparatus 1 102 by utilizing an interprocess commu- 
nication function provided by the operating system. 
[0173] In the case that the contents reproducing 
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software used in the reproducing apparatus 1102 is 
solely operated independent from this embodiment 
mode, an event signal which is produced by depressing 
the keyboard, or by manipulating the mouse, is transmit- 
ted to the contents reproducing software by utilizing 
either the process provided by the operating system or 
the communication function. 

[0174] Also, in this embodiment mode, since the 
control signal 1104 is transmitted to the contents repro- 
ducing software saved in the reproducing apparatus 

1102 by using a similar inter process communication 
function, the reproducing apparatus 1102 may interpret 
this control signal 1104 derived from the relay control 
unit 1 201 in such a way that this control signal 1 1 04 is 
produced by actually depressing the keyboard, or actu- 
ally manipulating the mouse. The control apparatus 

1 103 can change the display condition of the reproduc- 
ing apparatus 1 102 by employing such a means. 
[0175] It should also be noted that the format of the 
compressed moving picture data usable in this second 
embodiment mode is identical to the format of the com- 
pressed moving picture data usable in the first embodi- 
ment mode. 

[0176] Similar to the first embodiment mode, in the 
picture data relaying apparatus 103 according to this 
embodiment mode, the video memory may be replaced 
by a semiconductor memory such as a DRAM, or a stor- 
age apparatus such as a magnetic disk apparatus. 
[0177] As previously described, in accordance with 
this embodiment mode, since the contents data 110 
saved in the service providing apparatus 109, namely 
the home page described in the HTML, is converted into 
the compressed moving picture data by the service 
relaying apparatus 1 101 , this contents data 110 can be 
displayed by such a terminal 106 having no function 
capable of displaying this data (HTML). 
[0178] Also, with respect to the contents data 1 10 
under display, the terminal 106 can perform the follow- 
ing operations, namely, the entire area of this contents 
data 110 is displayed and an arbitrary data portion 
thereof is displayed in an enlarge manner; the contents 
data 1 1 0 is moved along the upper/lower/right/left direc- 
tions (scroll display); and the displayed content of the 
contents data 1 10 is changed by using the link informa- 
tion (URL) contained in this contents data 110. As a 
consequence, there is a great practical merit. 

[EMBODIMENT 3] 

[0179] A third embodiment mode of the present 
invention will now be described with reference to Fig. 1 6 
to Fig. 20. 

[0180] Fig. 16 represents a structural diagram of 
the third embodiment mode. In Fig. 16, reference 
numeral 1601 shows a service relaying apparatus; and 
reference numeral 1602 is a control apparatus. Other 
structural elements of the third embodiment mode are 
identical to those of the second embodiment mode. A 



major different point between the arrangement of the 
third embodiment mode and the arrangement of the 
second embodiment mode is the control apparatus 
1602 in the service relaying apparatus 1601 . 
5 [0181] First, a description will now be made of usa- 
ble modes directed to this embodiment mode. 
[0182] Although the terminal 106 is identical to the 
terminal 106 employed in the second embodiment 
mode, the contents data 1 1 0 displayed on this terminal 
io 1 06 is different from each other. The contents data 1 1 0 
expected in the third embodiment mode is a home page 
described by the HTML (Hyper Text Markup Language), 
and is constituted by an animation using computer 
graphics in addition to both character data and still pie- 
rs tu re data. 

[0183] When such a contents data 1 10 is displayed 
on the terminal 106, the entire area of the contents data 
110 is first compressed and then, the compressed con- 
tents data is displayed. As apparent from the foregoing 

so description, the entire image of the contents data dis- 
played on the terminal 1 06 owns low visibility as to very 
small areas thereof. As a result, an arbitrary partial por- 
tion of the contents data 110 is enlarged by arbitrarily 
setting magnification by manipulating the operation but- 

25 ton 1 1 7 equipped on the terminal 1 06 so as to display a 
detailed portion of this contents data 110. In addition, a 
home page under display is moved along 
upper/lower/right/left directions, and also other home 
pages related to the first-mentioned home page by an 

30 URL (Universal Resource Locator) are selected/dis- 
played by the operation button 117. 
[0184] Next, a description will be made of both 
operations of this embodiment mode and realizing 
means thereof. 

35 [0185] Operations of the control apparatus 1602 will 
now be explained. Fig. 17 shows an arrangement of the 
control apparatus 1602. In Fig. 17, reference numeral 

1701 indicates a relay control unit, reference numeral 

1702 indicates a communication path between this con- 
40 trol apparatus 1 602 and the network interface 1 1 6b, and 

reference numeral 1703 shows a communication path 
between this control apparatus 1602 and the network 
interface 115b. Other structural elements are identical 
to those of the control apparatus 1103 in the second 

45 embodiment mode. 

[0186] The communication control unit 202 per- 
forms a basic control operation for communication 
between the terminal 106 and the service relaying 
apparatus 1601 similar to the second embodiment 

50 mode. After the communication between the terminal 
106 and the service relaying apparatus 1601 is estab- 
lished by the communication control unit 202, a major 
function of the control apparatus 1 602 is provided by the 
relay control unit 1701. Similar to the above-explained 

55 second embodiment mode, the relay control unit 1701 
selects data to be sent to the terminal 106, namely 
selects either character data or compressed moving 
picture data. 
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[0187] Now, a description will be made of a process 
operation for converting the contents data 110 into the 
compressed moving pictu re data and for transmitting 
the compressed moving picture data to the terminal 
1 06. In this case, only different process operation of this 
third embodiment mode from the second embodiment 
mode will now be explained. 

[0188] A different point between this third embodi- 
ment mode and the second embodiment mode is such 
that the contents data of this third embodiment mode 
owns motion. In other words, the contents data 110 
employed in the second embodiment mode corre- 
sponds to the home page constituted by the character 
data and the still picture data, whereas the contents 
data 110 employed in this third embodiment mode cor- 
responds to such a home page described by the HTML, 
but also containing an animation with use of computer 
graphics. 

[0189] Now, a description will be made of opera- 
tions of the respective structural elements and realizing 
means in the case that with respect to such a contents 
data 110, similar to the various operations of the second 
embodiment mode, the following operations are carried 
out. That is to say, the entire area of the contents data 
110 is displayed and an arbitrary data portion thereof 
are displayed in an enlarge manner; the contents data 
110 is moved along the upper/lower/right/left directions 
(scroll display); and the display content of the contents 
data 110 is changed based upon the link information 
(URL) contained in the content data 1 1 0. 
[0190] Both a displaying method for displaying the 
entire area of the contents data 1 10 and an enlarging 
display method for displaying an arbitrary data portion 
thereof are similar to the method for displaying a portion 
of the contents data 110 in the enlarge manner, as 
described in the first embodiment mode. A different 
point is given as follows. That is, the moving picture cod- 
ing apparatus 1 04 is continuously operated in the nor- 
mal moving picture mode. As previously explained, 
since the contents data 110 expected in this third 
embodiment mode owns motion, this moving picture 
coding apparatus 104 must be continuously operated in 
the normal moving picture mode. As a consequence, 
the relay control unit 1701 continuously sets the opera- 
tion mode saved in the operation control information 
memory 304 to the normal moving picture mode, so that 
the moving picture coding apparatus 104 is always 
operated in the normal moving picture mode. As a con- 
sequence, the entire area of the contents data 1 1 0 hav- 
ing motion and the arbitrarily selected partial data of this 
contents data 1 10 can be displayed. 
[0191] A description will now be made of operations 
and realizing means, according to this embodiment 
mode, for moving the contents data 110 along the 
upper/lower/right/left directions, and also for changing 
the display content of the contents data 1 1 0 based upon 
the link information (URL) contained in the contents 
data 110. 



[0192] Similar to the second embodiment mode, the 
relay control unit 1701 saves such information related to 
the contents data 110 which has been stored in the 
operation control information memory 304 in an internal 
5 storage unit (not shown in detail) thereof. In other 
words, this relay control unit 1701 saves; 

a position (xdO, ydO) and a dimension (Xd, Yd) of 
the codable bit map data 403 stored in the picture 
10 data relaying apparatus 103, and a position (xtO, 
ytO) and a dimension (Xt, Yt) of the area 405 which 
is actually coded within the bit map data 403; and in 
addition, 

a total pixel number indicative of 1 move unit of the 
15 reproducing apparatus 1102 along the 
upper/lower/right/left directions; 
a position of a pointing cursol within the area 405; 
and 

a total pixel number indicative of 1 move unit of the 
20 pointing cursol. It should be noted that major oper- 
ations of the terminal 106 and the relay control unit 
1701 are identical to those of the second embodi- 
ment mode, only different points will be described. 

25 [0193] The operation mode of the moving picture 
coding apparatus 104 in this embodiment mode is con- 
tinuously set to the normal moving picture mode. As a 
result, an operation flow of the relay control unit 1 701 for 
explaining that the contents data 110 is moved along 

30 the upper/lower/right/left directions is represented in 
Fig. 18. Also, operation flows of the relay control unit 
1701 for describing that the pointing cursor is moved, 
and the link information is selected/defined are indi- 
cated in Fig. 19 and Fig. 20. 

35 [0194] The respective steps defined in the flow 
operation of Fig. 18 may correspond to those defined in 
the flow operation of Fig. 1 3 as follows: 

A process operation defined at a step 1801 is iden- 

40 tical to that defined at a step 1 301 ; 

A process operation defined at a step 1802 is iden- 
tical to that defined at a step 1303; 
A process operation defined at a step 1803 is iden- 
tical to that defined at a step 1 304; 

45 A process operation defined at a step 1 804 is iden- 
tical to that defined at a step 1305; and 
A process operation defined at a step 1805 is iden- 
tical to that defined at a step 1306. 

so [0195] The respective steps defined in the flow 
operation of Fig. 19 may correspond to those defined in 
the flow operation of Fig. 14 as follows; 

A process operation defined at a step 1901 is iden- 
55 tical to that defined at a step 1 401 ; 

A process operation defined at a step 1902 is iden- 
tical to that defined at a step 1403; 
A process operation defined at a step 1903 is iden- 
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tical to that defined at a step 1404, 
A process operation defined at a step 1904 is iden- 
tical to that defined at a step 1405; and 
A process operation defined at a step 1 905 is iden- 
tical to that defined at a step 1 406. 

[0196] The respective steps defined in the flow 
operation of Fig. 20 may correspond to those defined in 
the flow operation of Fig. 1 5 follows: 

A process operation defined at a step 2001 is iden- 
tical to that defined at a step 1501 ; and 
A process operation defined at a step 2002 is iden- 
tical to that defined at a step 1 503. 

[0197] In other words, the relay control unit 1701 
employed in this embodiment mode causes the moving 
picture coding apparatus 104 to be continuously oper- 
ated in the normal moving picture mode. 
[0198] It should also be noted that the format of the 
compressed moving picture data usable in this third 
embodiment mode is identical to the format of the com- 
pressed moving picture data usable in the first embodi- 
ment mode. 

[0199] Similar to the first embodiment mode, in the 
picture data relaying apparatus 103 according to this 
embodiment mode, the video memory may be replaced 
by a semiconductor memory such as a DRAM, or a stor- 
age apparatus such as a magnetic disk apparatus. 
[0200] As previously described, in accordance with 
this embodiment mode, since the contents data 110 
saved in the service providing apparatus 109, namely 
the home page having motion data (animation made of 
computer graphics) described in the HTML, is con- 
verted into the compressed moving picture data by the 
service relaying apparatus 1 1 01 , this contents data 1 1 0 
can be displayed by such a terminal 1 06 having no func- 
tion capable of displaying this data (HTML). 
[0201] Also, with respect to the contents data 1 10 
under display, the terminal 106 can perform the follow- 
ing operations, namely, the entire area of this contents 
data 110 is displayed and an arbitrary data portion 
thereof is displayed in an enlarge manner; the contents 
data 1 10 is moved along the upper/lower/right/left direc- 
tions (scroll display); and the displayed content of the 
contents data 1 10 is changed by using the link informa- 
tion (URL) contained in this contents data 110. As a 
consequence, there is a great practical merit. 

[EMBODIMENT MODE 4] 

[0202] A fourth embodiment mode of the present 
invention will now be described with reference to Fig. 21 
to Fig. 22. 

[0203] Fig. 21 represents a structural diagram of 
the fourth embodiment mode. In Fig. 21, reference 
numeral 2101 shows a service relaying apparatus; ref- 
erence numeral 2102 shows a moving picture coding 



apparatus; and reference numeral 2103 is a control 
apparatus. Also, reference numeral 2104 shows audio 
data contained in the contents data 110; reference 
numeral 2105 denotes a control signal of the moving 
5 picture coding apparatus 21 03; reference numeral 21 06 
shows a multimedia communication terminal; and fur- 
thermore reference numeral 2107 shows a moving pic- 
ture reproducing apparatus. Other structural elements 
of the fourth embodiment mode are identical to those of 
J0 the first embodiment mode. A major different point 
between the arrangement of the fourth embodiment 
mode and the arrangement of the first embodiment 
mode is both the moving picture coding apparatus 2102 
and the control apparatus 2103 in the service relaying 
r 5 apparatus 2101 , and also the moving picture reproduc- 
ing apparatus 2107 in the multimedia communication 
terminal 2106 (will be referred to as a "terminal"' herein- 
after). 

[0204] First, a description will now be made of usa- 
20 ble modes directed to this embodiment mode. 

[0205] Similar to the first embodiment mode, both 
the contents data 110 and digital still picture data which 
are stored in the service providing apparatus 109 are 
displayed on the terminal 2106. At this time, the con- 
25 tents data 1 1 0 owns the audio data in addition to the still 
picture data. As a consequence, the still picture is dis- 
played and at the same time, the audio data is repro- 
duced at the terminal 21 06. 

[0206] Next, operations of this embodiment mode 
30 and realizing means thereof will now be explained. 
[0207] The moving picture reproducing apparatus 
21 07 employed in the terminal 21 06 owns such a func- 
tion capable of decoding/displaying compressed mov- 
ing image data similar to the moving picture reproducing 
35 apparatus 107 according to the first embodiment mode, 
and furthermore, another function capable of decod- 
ing/reproducing audio data which is transmitted at the 
same time as the compressed moving picture data. 
[0208] Fig. 22 shows a structural diagram of the 
40 moving picture coding apparatus 2102. 

[0209] In Fig. 22, reference numeral 2201 indicates 
an audio codec unit; reference numeral 2202 represents 
a multiplexing unit; reference numeral 2203 shows an 
operation control information memory; reference 
45 numeral 2204 represents multiplexed AV data; and ref- 
erence numeral 2205 is a control signal. Other struc- 
tural elements of this fourth embodiment are identical to 
those of the moving picture coding apparatus 104 in the 
first embodiment mode. 
50 [0210] The information used to define the opera- 
tions of the moving picture coding apparatus 2102 is 
stored into the operation control information memory 
2203 via the control signal 2105. In this embodiment 
mode, the information stored in the operation control 
55 information memory 2203 is given as follows in addition 
to the information stored in the operation control infor- 
mation memory 304 in the first embodiment mode: 
[021 1] That is to say, a storage position and a data 
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amount of the audio data 2104; 

a coding format and a bit rate of the audio data 
21 04; 

a coding format and a bit rate of audio data output- 
ted by the audio codec unit 2201 ; and 
a bit rate of the multiplexed AV data 2204 outputted 
by the multiplexing unit 2202. 

[021 2] Next, a description will now be made of oper- 
ations of the moving picture coding apparatus 21 02. 
[0213] Since a producing operation of compressed 
moving picture data by the moving picture coding appa- 
ratus 2102 is identical to that of the first embodiment 
mode, only a different producing operation from that of 
the moving picture coding apparatus 104 according to 
the first embodiment mode will now be described. 
[0214] Upon receipt of a control signal 2205 from 
the data acquiring unit 301, an audio codec unit 2201 
derives such information required to produce audio data 
from the operation control information memory 2204. 
This control signal 2205 implies that the operation is 
commenced. Also, the audio codec unit 2201 derives 
designated audio data from the service providing appa- 
ratus 109 via the communication path 112 and the net- 
work interfaces 116a/116b, and then converts this 
derived audio data into desirable audio data. 
[0215] When the multiplexing unit 2202 receives 
such a control signal which implies the commencement 
of the operation from the data acquiring unit 301, the 
multiplexing unit 2202 derives information required to 
execute the multiplexing process operation from the 
operation control information memory 2204. Then, the 
multiplexing unit 2202 multiplexes the compressed mov- 
ing picture data supplied from the moving picture coding 
unit 303 with the audio data supplied from the audio 
codec unit 2201 so as to produce the multiplexed AV 
data 2204, and then transfers this multiplexed AV data 
2204 to the terminal 2106. 

[0216] As previously explained, the control appara- 
tus 2103 performs a control process operation via a 
control signal 2105 in such a manner that the moving 
picture coding apparatus 2102 is operated. Similar to 
the control apparatus 105 employed in the first embodi- 
ment mode, this control apparatus 2103 executes a 
basic communication control operation between the 
service relaying apparatus 2101 and the terminal 21 06. 
[021 7] It shou Id also be noted that the format of the 
compressed moving picture data usable in this second 
embodiment mode is identical to the format of the com- 
pressed moving picture data usable in the first embodi- 
ment mode. 

[0218] Similar to the first embodiment mode, in the 
picture data relaying apparatus 103 according to this 
embodiment mode, the video memory may be replaced 
by a semiconductor memory such as a DRAM, or a stor- 
age apparatus such as a magnetic disk apparatus. 
[0219] As previously described, in accordance with 



this fourth embodiment mode, since the contents data 
110 saved in the service providing apparatus 109, 
namely the still picture data having the audio data, is 
converted into the multiplexed AV data by the service 
5 relaying apparatus 2101, this contents data 1 1 0 can be 
displayed by such a terminal 106 having no function 
capable of displaying this multiplexed AV data. As a 
consequence, there is a great practical merit. 

10 [EMBODIMENT 5] 

[0220] A fifth embodiment mode of the present 
invention will now be described with reference to Fig. 
23. 

15 [0221] Fig. 23 represents a structural diagram of 
the fifth embodiment mode. In Fig. 23, reference 
numeral 2301 shows a service providing apparatus. 
Other structural elements of the fifth embodiment mode 
are identical to those of the first embodiment mode. A 

20 major different point between the arrangement of the 
fifth embodiment mode and the arrangement of the first 
embodiment mode is such that the service relaying 
apparatus 101 is no longer required. First, a usable 
mode directed to this embodiment mode is identical to 

25 that of the first embodiment mode. 

[0222] Next, operations of this embodiment mode 
will now be described. 

[0223] Both the reproducing apparatus 1 02 and the 
control apparatus 105 directly derive the contents data 
30 110, and execute a subsequent process operation of 
this contents data 110, different from the first embodi- 
ment mode in which the contents data 1 1 0 is derived via 
the network interfaces 116a/116b and the communica- 
tion path 112. 

35 [0224] It shou Id also be noted that the format of the 
compressed moving picture data usable in this fifth 
embodiment mode is identical to the format of the com- 
pressed moving picture data usable in the first embodi- 
ment mode. 

40 [0225] Similar to the first embodiment mode, in the 
picture data relaying apparatus 103 according to this 
embodiment mode, the video memory may be replaced 
by a semiconductor memory such as a DRAM, or a stor- 
age apparatus such as a magnetic disk apparatus. 

45 [0226] As previously explained, in accordance with 
this fifth embodiment mode, since the contents data 
saved in the service providing apparatus 109, namely 
the still picture data formatted by the JPEG system is 
converted into the compressed moving picture data, this 

so still picture can be displayed by employing the terminal 
106 which does not have the still picture display func- 
tion. Also, since the compressed moving picture data is 
produced by the stepwise image quality complementing 
method, the still picture can be displayed with having 

55 the high image quality substantially equal to the original 
image quality. Furthermore, since the video memory (V- 
RAM) is employed in the image data relaying apparatus 
103, the commercially available still picture display soft- 
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ware such as a commercial software product can be uti- 
lized, and also such a service relaying apparatus 101 
adapted to various data formatted contents data 110 
can be readily realized, which may improve practical 
merits. 

[EMBODIMENT MODE 6] 

[0227] A sixth embodiment mode of the present 
invention will now be described with reference to Fig. 
24. 

[0228] Fig. 24 represents a structural diagram of 
the sixth embodiment mode. In Fig. 24, reference 
numeral 2401 shows a service providing apparatus. 
Other structural elements of the sixth embodiment 
mode are identical to those of the second embodiment 
mode. A major different point between the arrangement 
of the sixth embodiment mode and the arrangement of 
the second embodiment mode is that the service relay- 
ing apparatus 1 101 is no longer required. First, a usable 
mode directed to this embodiment mode is identical to 
that of the second embodiment mode. 
[0229] Next, operations of this embodiment mode 
will now be described. 

[0230] Both the reproducing apparatus 1102 and 
the control apparatus 1103 directly derive the contents 
data 1 10, and execute a subsequent process operation 
of this contents data 110, different from the second 
embodiment mode in which the contents data 110 is 
derived via the network interfaces 1 1 6a/1 1 6b and the 
communication path 112. 

[0231] It can be apparently understood that this 
sixth embodiment mode may be readily applied to the 
usable mode directed to the third embodiment mode. It 
should further be noted that the format of the com- 
pressed moving picture data usable in this sixth embod- 
iment mode is identical to the format of the compressed 
moving picture data usable in the first embodiment 
mode. 

[0232] Similar to the first embodiment mode, in the 
picture data relaying apparatus 103 according to this 
embodiment mode, the video memory may be replaced 
by a semiconductor memory such as a DRAM, or a stor- 
age apparatus such as a magnetic disk apparatus. 
[0233] As previously described, in accordance with 
this sixth embodiment mode, since the contents data 
110 saved in the service providing apparatus 109, 
namely the home page described in the HTML, is con- 
verted into the compressed moving picture data, this 
contents data 1 10 can be displayed by such a terminal 
106 having no function capable of displaying this data 
(HTML). Also, with respect to the contents data 110 
under display, the terminal 106 can perform the follow- 
ing operations, namely, the entire area of this contents 
data 110 is displayed and an arbitrary data portion 
thereof is displayed in an enlarge manner; the contents 
data 1 10 is moved along the upper/lower/right/left direc- 
tions (scroll display); and the displayed content of the 



contents data 1 10 is changed by using the link informa- 
tion (URL) contained in this contents data 1 10. 

[EMBODIMENT 7] 

5 

[0234] A seventh embodiment mode of the present 
invention will now be described with reference to Fig. 
25. 

[0235] Fig. 25 represents a structural diagram of 
io the seventh embodiment mode. In Fig. 25, reference 
numeral 2501 shows a service providing apparatus. 
Other structural elements of the seventh embodiment 
mode are identical to those of the fourth embodiment 
mode. A major different point between the arrangement 
15 of the seventh embodiment mode and the arrangement 
of the fourth embodiment mode is that the service relay- 
ing apparatus 2101 is no longer required. First, a usable 
mode directed to this embodiment mode is identical to 
that directed to the fourth embodiment mode. 
20 [0236] Next, operations of this embodiment mode 
will now be described. 

[0237] Both the reproducing apparatus 1 02 and the 
control apparatus 2103 directly derive the contents data 
110, and execute a subsequent process operation of 
25 this contents data 110, different from the fourth embod- 
iment mode in which the contents data 1 10 is derived 
via the network interfaces 1 16a/1 16b and the communi- 
cation path 112. 

[0238] It should also be noted that the format of the 
30 compressed moving picture data usable in this seventh 
embodiment mode is identical to the format of the com- 
pressed moving picture data usable in the first embodi- 
ment mode. 

[0239] Similar to the first embodiment mode, in the 
35 picture data relaying apparatus 103 according to this 
seventh embodiment mode, the video memory may be 
replaced by a semiconductor memory such as a DRAM, 
or a storage apparatus such as a magnetic disk appara- 
tus. 

40 [0240] As previously described, in accordance with 
this embodiment mode, since the contents data 110 
saved in the service providing apparatus 109, namely 
the still picture data having the audio data, is converted 
into the multiplexed AV data, this contents data 1 1 0 can 

45 be displayed by such a terminal 1 06 having no function 
capable of displaying this still picture data. As a conse- 
quence, there is a great practical merit. 
[0241] It should also understood that in the embod- 
iment modes 1 to 4 of the present invention, the service 

so providing apparatus 109 (server "S") is separated from 
the service relaying apparatus 101 (gateway GW) 
(referred to as a "first mode" hereinafter), whereas in 
the embodiment modes 5 to 7 of the present invention, 
both the service providing apparatus 109 and the serv- 

55 ice relaying apparatus 101 are arranged in an integral 
form (will be referred to as a "second mode" hereinaf- 
ter). In other words, as the first mode, the following 
cases may be conceived. Namely, while a large number 
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of servers are provided, if the gateways GWs are pro- 
vided with the respective servers S, then the efficiency 
of this structure will become insufficient in view of the 
construction cost. Also, an industry who may provide a 
network infrastructure installs a gateway GW by herself 
(see Fig. 26). Furthermore, as the second mode, the fol- 
lowing cases may be conceived. Namely, the gateways 
GWs are provided with the severs S respectively. Also, 
an industry who may provide a network infrastructure 
does not install a gateway GW by herself (see Fig. 27). 
The present invention may provide optimum system 
modes in correspondence with these conditions. 
[0242] As previously described, in accordance with 
the present invention, firstly, the service relaying appa- 
ratus is arranged by employing: 

the service providing apparatus for storing thereinto 
a plurality of contents data and capable of transmit- 
ting the desirable contents data via the network 
interface in response to the request; 
the moving picture coding apparatus for producing 
the compressed moving picture data having the 
high image quality from the still picture data by exe- 
cuting the stepwise image quality complementary 
type coding operation, and capable of transmitting 
the compressed moving picture data having the 
high image quality via the second network interface 
to the reproducing terminal; 
the picture data relaying means capable of utilizing 
the contents data reproducing software operated 
on a general-purpose personal computer as the 
reproducing apparatus, and for relaying to the mov- 
ing picture coding apparatus, the still picture data 
originated from the contents data which is obtained 
by reproducing the contents data acquired from the 
service providing apparatus via the network inter- 
face by this reproducing apparatus; and 
the control means for determining the area of the 
still picture data coded into the compressed moving 
picture data in response to the manipulation made 
from the reproducing terminal, and capable of noti- 
fying the determined area to the moving picture 
coding apparatus. 

[0243] As a result, the desirable contents data can 
be reproduced by such a reproducing terminal which 
does not have the capability of displaying the desirable 
contents data. In addition, the reproducing terminal can 
display an arbitrarily selected portion of contents data 
displayed on this reproducing terminal in an enlarging 
manner. 

[0244] As previously described, in accordance with 
the present invention, secondly, the service relaying 
apparatus is arranged by employing: 

the service providing apparatus for storing thereinto 
a plurality of contents data and capable of transmit- 
ting the desirable contents data via the network 



interface in response to the request; 
the moving picture coding apparatus for producing 
the compressed moving picture data having the 
high image quality from the still picture data by exe- 

5 cuting the stepwise image quality complementary 

type coding operation, for producing the com- 
pressed moving picture data from such a still pic- 
ture data whose content is sequentially changed by 
changing the setting condition of the coding proc- 

io ess operation, if necessary, and also capable of 
transmitting the compressed moving picture data 
having the high image quality via the second net- 
work interface to the reproducing terminal; 
the picture data relaying means capable of utilizing 

15 the contents data reproducing software operated 
on a general-purpose personal computer as the 
reproducing apparatus, and for relaying to the mov- 
ing picture coding apparatus, the still picture data 
originated from the contents data which is obtained 

20 by reproducing the contents data acquired from the 
service providing apparatus via the network inter- 
face by this reproducing apparatus; and 
the control means for producing the control signal 
used to change the display condition of the repro- 

25 ducing apparatus to transmit the control signal to 
the reproducing apparatus, and for determining the 
area of the still picture data coded into the com- 
pressed moving picture data in response to the 
manipulation made from the reproducing terminal, 

30 and also capable of notifying the determined area 
to the moving picture coding apparatus. 

[0245] As a resuh, the desirable contents data can 
be reproduced by such a reproducing terminal which 

35 does not have the capability of displaying the desirable 
contents data. In addition, the reproducing terminal can 
display an arbitrarily selected portion of contents data 
displayed on this reproducing terminal in an enlarging 
manner. Also, the reproducing terminal can move the 

40 displayed content along the upper/lower/right/left direc- 
tions, and can display the relevant contents data by arbi- 
trarily selecting the displayed link information. 
[0246] As previously described, in accordance with 
the present invention, thirdly, the service relaying appa- 

45 ratus is arranged by employing: 

the service providing apparatus for storing thereinto 
a plurality of contents data and capable of transmit- 
ting the desirable contents data via the network 

50 interface in response to the request; 

the moving picture coding apparatus for producing 
the compressed moving picture data having the 
high image quality from the still picture data by exe- 
cuting the stepwise image quality complementary 

55 type coding operation, capable of producing the 
audio data having the designated format from such 
an audio data contained in the contents data, and 
for multiplexing the compressed moving picture 
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data with the audio data to thereby produce the 
multiplexed AV data, and also capable of transmit- 
ting the multiplexed AV data having the high image 
quality via the second network interface to the 
reproducing terminal; 5 
the picture data relaying means capable of utilizing 
the contents data reproducing software operated 
on a general-purpose personal computer as the 
reproducing apparatus, and for relaying to the mov- 
ing picture coding apparatus, the still picture data 10 
originated from the contents data which is obtained 
by reproducing the contents data acquired from the 
service providing apparatus via the network inter- 
face by this reproducing apparatus; and 
the control means for determining the area of the 15 
still picture data coded into the compressed moving 
picture data in response to the manipulation made 
from the reproducing terminal, and capable of noti- 
fying the determined area to the moving picture 
coding apparatus. 20 

[0247] As a result, the desirable contents data can 
be reproduced by such a reproducing terminal which 
does not have the capability of displaying the desirable 
contents data, while reproducing the audio. In addition, 25 
the reproducing terminal can display an arbitrarily 
selected portion of contents data displayed on this 
reproducing terminal in an enlarging manner. 
[0248] As previously described, in accordance with 
the present invention, fourthly, the service relaying 30 
apparatus is arranged by employing: 

the moving picture coding apparatus for producing 
the compressed moving picture data having the 
high image quality from the still picture data by exe- 35 
cuting the stepwise image quality complementary 
type coding operation, and capable of transmitting 
the compressed moving picture data having the 
high image quality via the network interface to the 
reproducing terminal; 40 
the picture data relaying means capable of utilizing 
the contents data reproducing software operated 
on a general-purpose personal computer as the 
reproducing apparatus, and for relaying to the mov- 
ing picture coding apparatus, the still picture data 45 
originated from the contents data which is obtained 
by reproducing the contents data acquired from the 
service providing apparatus via the network inter- 
face by this reproducing apparatus; 
the control means for determining the area of the so 
still picture data coded into the compressed moving 
picture data in response to the manipulation made 
from the reproducing terminal, and capable of noti- 
fying the determined area to the moving picture 
coding apparatus; and 55 
the service providing apparatus for storing thereinto 
a plurality of contents data and capable of transmit- 
ting the desirable contents data via the network 



interface in response to the request. 

[0249] As a result, the desirable contents data can 
be reproduced by such a reproducing terminal which 
does not have the capability of displaying the desirable 
contents data. In addition, the reproducing terminal can 
display an arbitrarily selected portion of contents data 
displayed on this reproducing terminal in an enlarging 
manner. 

[0250] As previously described, in accordance with 
the present invention, fifthly, the service relaying appa- 
ratus is arranged by employing: 

the moving picture coding apparatus for producing 
the compressed moving picture data having the 
high image quality from the still picture data by exe- 
cuting the stepwise image quality complementary 
type coding operation, for producing the com- 
pressed moving picture data from such a still pic- 
ture data whose content is sequentially changed by 
changing the setting condition of the coding proc- 
ess operation, if necessary, and also capable of 
transmitting the compressed moving picture data 
having the high image quality via the network inter- 
face to the reproducing terminal; 
the picture data relaying means capable of utilizing 
the contents data reproducing software operated 
on a general-purpose personal computer as the 
reproducing apparatus, and for relaying to the mov- 
ing picture coding apparatus, the still picture data 
originated from the contents data which is obtained 
by reproducing the contents data acquired from the 
service providing apparatus via the network inter- 
face by this reproducing apparatus; 
the control means for producing the control signal 
used to change the display condition of the repro- 
ducing apparatus to transmit the control signal to 
the reproducing apparatus, and for determining the 
area of the still picture data coded into the com- 
pressed moving picture data in response to the 
manipulation made from the reproducing terminal, 
and capable of notifying the determined area to the 
moving picture coding apparatus; and 
the service providing apparatus for storing thereinto 
a plurality of contents data and capable of transmit- 
ting the desirable contents data via the network 
interface in response to the request. 

[0251] As a result, the desirable contents data can 
be reproduced by such a reproducing terminal which 
does not have the capability of displaying the desirable 
contents data. In addition, the reproducing terminal can 
display an arbitrarily selected portion of contents data 
displayed on this reproducing terminal in an enlarging 
manner. Also, the reproducing terminal can move the 
displayed content along the upper/lower/right/left direc- 
tions, and can display the relevant contents data by arbi- 
trarily selecting the displayed link information. 
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[0252] As previously described, in accordance with 
the present invention, sixthly, the service relaying appa- 
ratus is arranged by employing: 

the moving picture coding apparatus for producing 5 
the compressed moving picture data having the 
high image quality from the still picture data by exe- 
cuting the stepwise image quality complementary 
type coding operation, capable of producing the 
audio data having the designated format from such 10 
an audio data contained in the contents data, and 
for multiplexing the compressed moving picture 
data with the audio data to thereby produce the 
multiplexed AV data, and capable of transmitting 
the compressed moving picture data having the 15 
high image quality via the network interface to the 
reproducing terminal; 

the picture data relaying means capable of utilizing 
the contents data reproducing software operated 
on a general-purpose personal computer as the 20 
reproducing apparatus, and for relaying to the mov- 
ing picture coding apparatus, the still picture data 
originated from the contents data which is obtained 
by reproducing the contents data acquired from the 
service providing apparatus via the network inter- 25 
face by this reproducing apparatus; 
the control means for determining the area of the 
still picture data coded into the compressed moving 
picture data in response to the manipulation made 
from the reproducing terminal, and capable of noti- 30 
tying the determined area to the moving picture 
coding apparatus; and 

the service providing apparatus for storing thereinto 
a plurality of contents data and capable of transmit- 
ting the desirable contents data via the network 35 
interface in response to the request. 

[0253] As a result, the desirable contents data can 
be reproduced by such a reproducing terminal which 
does not have the capability of displaying the desirable 40 
contents data, while reproducing the audio. In addition, 
the reproducing terminal can display an arbitrarily 
selected portion of contents data displayed on this 
reproducing terminal in an enlarging manner. 

Claims 

1. An information providing apparatus for acquiring 
data from a service providing apparatus capable of 
storing contents data and of transmitting the con- 
tents data in response to a request, and for provid- 
ing said acquired contents data in a direct format, or 
in a converted format, said information providing 
comprising: 

reproducing means for reproducing the con- 
tents data; 

image data for relaying still picture data origi- 
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nated from the contents data reproduced by 
the reproducing means; 
moving picture coding means for producing 
compressed moving picture data having a high 
image quality from the still picture image data 
by way of a stepwise image quality comple- 
mentary type coding system corresponding to 
a coding system for complementing an image 
quality in a stepwise manner, and for transmit- 
ting the compressed moving picture data to the 
user terminal; and 

control means for determining an area of still 
picture data coded into the compressed mov- 
ing picture data in response to a manipulation 
made from the user terminal, and capable of 
notifying the determined area to the moving 
picture coding means. 

2. An information providing apparatus as claimed in 
claim 1 , wherein said control means is capable of 
producing a control signal used to change the 
reproducing state of the reproducing means by 
receiving a manipulation of the user terminal, and is 
capable of transmitting the control signal to the 
reproducing means; and 

the moving picture coding means produces 
compressed moving picture data from such still 
picture data, the content of which is sequen- 
tially changed by changing a setting condition 
of coding process operation, if necessary. 

3. An information providing apparatus as claimed in 
claim 1, wherein the moving picture coding means 
produces audio data having a designated data for- 
mat from audio data contained in the contents data, 
produces multiplexed AV data by multiplexing the 
compressed moving data with the audio data, and 
transmits the multiplexed AV data to the user termi- 
nal. 

4. An information providing apparatus for providing 
data to a user terminal in response to a request, 
comprising: 

storing means for storing contents data; 
reproducing means for reproducing the con- 
tents data; 

image data for relaying still picture data origi- 
nated from the contents data reproduced by 
the reproducing means; 
moving picture coding means for producing 
compressed moving picture data having a high 
image quality from the still picture image data 
by way of a stepwise image quality comple- 
mentary type coding system corresponding to 
a coding system for complementing an image 
quality in a stepwise manner, and for transmit- 
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ting the compressed moving picture data to the 
user terminal; and 

control means for determining an area of still 
picture data coded into the compressed mov- 
ing picture data in response to a manipulation 5 
made from the user terminal, and capable of 
notifying the determined area to the moving 
picture coding means. 

5. An information providing apparatus as claimed in 10 
claim 4, wherein said control means is capable of 
producing a control signal used to change the 
reproducing state of the reproducing means by 
receiving a manipulation of the userterminal, and is 
capable of transmitting the control signal to the 15 
reproducing means; and 

the moving picture coding means produces 
compressed moving picture data from such still 
picture data, the content of which is sequen- 20 
tially changed by changing a setting condition 
of coding process operation, if necessary. 

6. An information providing apparatus as claimed in 
claim 4, wherein the moving picture coding means 25 
produces audio data having a designated data for- 
mat from audio data contained in the contents data, 
produces multiplexed AV data by multiplexing the 
compressed moving data with the audio data, and 
transmits the multiplexed AV data to the usertermi- 30 
nal. 
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